Yes, build automatically is always on. I don't think the builders get run when I first open Eclipse unless I use 'Refresh' on the project.
Not sure if it helps, but I have attached the builders configuration for this project.
It's not that big of a deal for me since getting it to work is very easy, but it might be confusing for new users if they hit the same problem...