The gems were being cached already.

I've now reconfigured the server to use a tmpfs drive as workspace for Jenkins, the build time is now *9 minutes 27 seconds". I guess the system caches were doing a decent job; I had already disabled disk synch on writes previously.

http://ci.hibernate.org/view/Website/job/staging.in.relation.to/13/