[jboss-jira] [JBoss JIRA] (JGRP-1423) TestNG reporting enhancements

[Bela Ban (JIRA)]

     [ https://issues.jboss.org/browse/JGRP-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bela Ban resolved JGRP-1423.
----------------------------

    Resolution: Done

    
> TestNG reporting enhancements
> -----------------------------
>
>                 Key: JGRP-1423
>                 URL: https://issues.jboss.org/browse/JGRP-1423
>             Project: JGroups
>          Issue Type: Enhancement
>            Reporter: Bela Ban
>            Assignee: Bela Ban
>             Fix For: 3.1
>
>
> JUnitXMLReporter doesn't includes all the tests:
> - When a test has an invocationCount, the code to determine the number of methods to run after which to generate the report, counts this method only *once*. Example: when we have methods foo(), bar() and @Test(invocationCount=5) foobar(), the count method returns 3, whereas the real number of tests run is 7. This means the report is generated after 3 methods run (callback: onTestSuccess()); we're *not* reporting 4 methods !
> - When we have a @DataProvider on a method foo(), the count method only counts it once, although the data provider may return more than 1 result. Same as above: we won't include all of the run methods in the report
> SOLUTION:
> - We don't generate the report in onTestSuccess(), but simply add every test method that's completed to a file (tests.data), in a directory named after the test class
> - We also created stdout.txt and stderr.txt in the same directory
> - At the end of the test (onFinish()), we iterate through all dirs and generate TEST-org.jgroups.XXX-suffix.xml files, which can then be used by the junitreporter ANT task to generate HTML.
> - There's also a new class CountTests which can be used to dump all the methods of all classes which will be run under TestNG
> - Another new class (DumpData) can be used to write the contents of tests.data to stdout

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira