Ryan Emerson, actually the test works as expected. The problem is that you added it to the hibernate-core module. If you look at hibernate.properties under test/resources you see that javax.persistence.validation.mode=NONE is set which disables Bean Validation for this module. If you change the value to for example AUTO, Bean Validation will be activated and the tests behave as expected.

Alternatively, one can move the whole test into the entity_manager module where Bean Validation is enabled.