Yes, annotations aren't dynamically read.
You can use the "Touch" icon in the menu for a project to touch the descriptor and trigger a redeploy.
p.s. Seam components is an exception for this, if you put the components in the /hot folder it will be reread (assuming it only has Seam annotations)