[jboss-jira] [JBoss JIRA] (WFLY-2893) Determine cause of unreported test failures

[Brian Stansberry (JIRA)]

Brian Stansberry created WFLY-2893:
--------------------------------------

             Summary: Determine cause of unreported test failures
                 Key: WFLY-2893
                 URL: https://issues.jboss.org/browse/WFLY-2893
             Project: WildFly
          Issue Type: Task
      Security Level: Public (Everyone can see)
          Components: Build System, Test Suite
    Affects Versions: 8.0.0.CR1
            Reporter: Brian Stansberry
            Assignee: Tomaz Cerar
             Fix For: 8.0.1.Final


Identify the reason why the failing tests that needed https://github.com/wildfly/wildfly/commit/90643bc435a9ba439cf2988e5b7407d1d48fb040 to get working did not fail the build. Those tests were failing for 2.5 months. Fortunately it was just a test problem, not a broken feature.

They involved separate surefire executions. We want to avoid those, but sometimes they are needed to use different config files. We have separate executions in testsuite/integration/basic as well, covering a much broader scope, so if this kind of problem happened there as well we could have a big problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira