[jboss-jira] [JBoss JIRA] Created: (JBAS-4103) testsuite testcases' reports overwritten

Fri Feb 16 04:51:29 EST 2007

testsuite testcases' reports overwritten
----------------------------------------

                 Key: JBAS-4103
                 URL: http://jira.jboss.com/jira/browse/JBAS-4103
             Project: JBoss Application Server
          Issue Type: Bug
      Security Level: Public (Everyone can see)
          Components: Test Suite
            Reporter: Aleksandar Kostadinov

When JBoss AS testsuite runs there is xml report produces for every testcase. If the same testcase is run twice without being renamed it overwrites the result from the previous run. This could lead to silent failures as if the first run fails and the second not, the final report will not show any problem.

There appear to be some testcases doing so. We've noticed only org.jboss.test.jmx.test.RMIAdaptorAuthorizationUnitTestCase to fail the first time and not the second one, but we'd better avoid the possibility of this happening in the future.

Affected seem to be many if not all current versions (4.0.4GA, 4.0.5GA, 4.0 branch, 4.2 branch, 5, etc.). See forum for a reference.

There will always be the possibility different targets to include same testcases so we should probably rename tests run by all but tests-standard-unit target.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.jboss.com/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira