[bv-dev] Skipped TCK tests

[Guillaume Smet]

On Tue, Mar 13, 2018 at 4:42 PM, Matt Benson <mbenson at apache.org> wrote:

> As mentioned elsewhere, the Apache BVal implementation of BV2 (which
> includes an extensive rewrite of much of our supporting code) is
> proceeding but we are seeing a large number of skipped tests. Our
> configuration looks very much like the Maven example pointed to by the
> TCK reference guide and can be observed at [1]. If anyone has any tips
> on how to determine what's causing so many skipped tests, they would
> be much appreciated.
>

OK, as far as I can see it skips all of the tests here, except the first
one.

I wonder if the test suite is skipped due to this issue:
arquillianBeforeClass(org.hibernate.beanvalidation.tck.
tests.xmlconfiguration.MissingClassNameOnBeanNodeTest)  Time elapsed: 0.292
s  <<< FAILURE!
org.apache.webbeans.exception.WebBeansDeploymentException:

I know that sometimes I have the same issue with the TCK for HV, when a
given test fails it decides to skip all the tests after it, and I wonder if
a failure in arquillianBeforeClass might not be a trigger for it.

Adding the following exclusion <exclude
name="org.hibernate.beanvalidation.tck.tests.xmlconfiguration"/> in the
suite file makes it run a few more tests so I think this might be a valid
assumption.

HTH.

-- 
Guillaume
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/beanvalidation-dev/attachments/20180313/9ad96d33/attachment.html