JCache tck-runner test failures are ignored in Jenkins ------------------------------------------------------ Key: ISPN-10379 URL: https://issues.jboss.org/browse/ISPN-10379 Project: Infinispan Issue Type: Bug Components: Build, Test Suite - Core Affects Versions: 10.0.0.Beta3 Reporter: Dan Berindei Assignee: Dan Berindei Priority: Major Labels: testsuite_stability Fix For: 10.0.0.CR3 This build has 0 failures in Jenkins, but the console log says otherwise: https://ci.infinispan.org/job/Infinispan/job/PR-7110/1/ {noformat} [2019-07-02T18:45:17.550Z] 18:45:16.738 [INFO] --- maven-failsafe-plugin:3.0.0-M3:integration-test (tck-embedded) @ infinispan-jcache-tck-runner --- [2019-07-02T18:45:17.550Z] 18:45:16.750 [INFO] Failsafe report directory: /home/infinispan/workspace/Infinispan_PR-7110/jcache/tck-runner/target/failsafe-reports-embedded ... [2019-07-02T18:45:53.348Z] 18:45:53.137 [ERROR] CacheExpiryTest.invokeAllReadThroughEnabledGetOnNonExistentEntry:1202 [2019-07-02T18:45:53.348Z] Expected: is <0> [2019-07-02T18:45:53.348Z] but: was <5> [2019-07-02T18:45:53.348Z] 18:45:53.137 [ERROR] CacheExpiryTest.invokeGetValueWithReadThroughForNonExistentEntryShouldCallGetExpiryForCreatedEntry:1110 [2019-07-02T18:45:53.348Z] Expected: is <0> [2019-07-02T18:45:53.348Z] but: was <1> [2019-07-02T18:45:53.348Z] 18:45:53.138 [ERROR] CacheWriterTest.shouldWriteThoughUsingPutAll_partialSuccess:688 expected:<2> but was:<3> [2019-07-02T18:45:53.348Z] 18:45:53.138 [INFO] [2019-07-02T18:45:53.348Z] 18:45:53.138 [ERROR] Tests run: 491, Failures: 3, Errors: 0, Skipped: 0 {noformat}