[arquillian-issues] [JBoss JIRA] (ARQ-2086) Test failures not reported with recent versions of TestNG

[Bartosz Majsak (JIRA)]

    [ https://issues.jboss.org/browse/ARQ-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494509#comment-13494509 ] 

Bartosz Majsak edited comment on ARQ-2086 at 11/28/17 3:25 AM:
---------------------------------------------------------------

Finally we have a fix landed in TestNG and Core, so grab it while it's hot. One important mark here, as 6.12 is not in Maven Central and 6.13 refers to JCommander version which is also not in Maven Central (sic!) you have two options:

* use 6.13.1 which has corrected dependencies
* add JCommander which is published to Maven Central before TestNG dependency e.g.:


{code:xml}
<!-- JCommander 1.66 is missing in Maven Central, thus taking newer one first -->
<dependency>
  <groupId>com.beust</groupId>
  <artifactId>jcommander</artifactId>
  <version>1.69</version>
  <scope>test</scope>
</dependency>
<dependency>
  <groupId>org.testng</groupId>
  <artifactId>testng</artifactId>
  <version>${version.testng}</version>
  <scope>test</scope>
</dependency>
{code}

Here's related thread: https://github.com/cbeust/testng/issues/1506#issuecomment-347178740


was (Author: bmajsak):
Finally we have a fix landed in TestNG and Core, so grab it while it's hot. One important mark here, as 6.12 is not in Maven Central and 6.13 refers to JCommander version which is also not in Maven Central (sic!) you have two options:

* use 6.13.1 which has corrected dependencies
* add JCommander which is published to Maven Central before TestNG dependency e.g.:


{code:xml}
<!-- Workaround https://github.com/cbeust/testng/issues/1506#issuecomment-347178740 -->
<!-- JCommander 1.66 is missing in Maven Central, thus taking newer one first -->
<dependency>
  <groupId>com.beust</groupId>
  <artifactId>jcommander</artifactId>
  <version>1.69</version>
  <scope>test</scope>
</dependency>
<dependency>
  <groupId>org.testng</groupId>
  <artifactId>testng</artifactId>
  <version>${version.testng}</version>
  <scope>test</scope>
</dependency>
{code}


> Test failures not reported with recent versions of TestNG
> ---------------------------------------------------------
>
>                 Key: ARQ-2086
>                 URL: https://issues.jboss.org/browse/ARQ-2086
>             Project: Arquillian
>          Issue Type: Bug
>    Affects Versions: 1.1.12.Final
>            Reporter: Gunnar Morling
>            Assignee: Dipak Pawar
>            Priority: Blocker
>             Fix For: 1.1..15.Final
>
>
> When using recent TestNG versions (> 6.8.21) with Arquillian, failing tests are accidentally reported as passing.
> A reproducer can be found at https://github.com/gunnarmorling/arquillian-testng-bug.
> There is a single test which is expected to fail, but it actually is reported as successful with TestNG 6.11. It is reported as failed as expected with 6.8.21. Run {{mvn clean install}} for reproducing.



--
This message was sent by Atlassian JIRA
(v7.5.0#75005)