Hi Andy Guibert, thanks for your report. Still need to read up and double-check on the spec, but I think your challenge is legit.

We'll have to see what we can do about it, as I'm not sure whether the testing infra we use in the TCK (Arquillian) allows us to mark a test as passed if either the deployment or the actual test method fails with a validation exception. In the worst case we'd have to mark those assertions as not testable and thus remove/disable them in the TCK, but that'd be a pity.