Just noticed that the build used rake test which atm does not use bundle exec. I see whether this makes a difference.