On Tue, Mar 13, 2018 at 4:42 PM, Matt Benson <mbenson@apache.org> wrote:

As mentioned elsewhere, the Apache BVal implementation of BV2 (which
includes an extensive rewrite of much of our supporting code) is
proceeding but we are seeing a large number of skipped tests. Our
configuration looks very much like the Maven example pointed to by the
TCK reference guide and can be observed at [1]. If anyone has any tips
on how to determine what's causing so many skipped tests, they would
be much appreciated.

OK, as far as I can see it skips all of the tests here, except the first one.

I wonder if the test suite is skipped due to this issue:
arquillianBeforeClass(org.hibernate.beanvalidation.tck.tests.xmlconfiguration.MissingClassNameOnBeanNodeTest) Time elapsed: 0.292 s <<< FAILURE!
org.apache.webbeans.exception.WebBeansDeploymentException:

I know that sometimes I have the same issue with the TCK for HV, when a given test fails it decides to skip all the tests after it, and I wonder if a failure in arquillianBeforeClass might not be a trigger for it.

Adding the following exclusion <exclude name="org.hibernate.beanvalidation.tck.tests.xmlconfiguration"/> in the suite file makes it run a few more tests so I think this might be a valid assumption.

HTH.

Guillaume