Sorry for the confusion. As hinted at here https://stackoverflow.com/a/41673581/947526 this is an issue somewhere in Spring Data or even in my own test code. The validation itself works as expected, it is just not triggered correctly in my test.