[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka updated AS7-2011: ------------------------------ Description: Make sure test reports are being produced correctly (this may involve chasing up Paul Gier for the surefire release). was: Make sure test reports are being produced correctly (this may involve chasing up Paul Gier for the surefire release) Will we use Ant task for this? See the SO answer here for reasoning: http://stackoverflow.com/questions/2846493/is-there-a-decent-html-junit-r... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka commented on AS7-2011: ----------------------------------- Maven site plugin takes ages to finish, and needs MAVEN_OPTS="-Xmx1024m" not to throuw "GC overhead limit". -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka commented on AS7-2011: ----------------------------------- See also JBBUILD-700 Remove reporting config from parent pom -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka edited comment on AS7-2011 at 10/16/11 8:57 PM: ------------------------------------------------------------- {code} <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-antrun-plugin</artifactId> <executions combine.children="append"> <execution> <id>reporting</id> <phase>compile</phase><!--post-integration-test--> <goals><goal>run</goal></goals> <configuration> <target> <property name="compile_classpath" refid="maven.compile.classpath"/> <property name="runtime_classpath" refid="maven.runtime.classpath"/> <property name="test_classpath" refid="maven.test.classpath"/> <property name="plugin_classpath" refid="maven.plugin.classpath"/> <echo message="compile classpath: ${compile_classpath}"/> <echo message="runtime classpath: ${runtime_classpath}"/> <echo message="test classpath: ${test_classpath}"/> <echo message="plugin classpath: ${plugin_classpath}"/> <ant antfile="${basedir}/../tools/report/buildReports.xml"> <!--<property name="reports.dest.dir" value=""/>--> <target name="reports"/> </ant> </target> </configuration> </execution> </executions> <dependencies> <dependency> <groupId>org.apache.ant</groupId> <artifactId>ant-antunit</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>ant-contrib</groupId> <artifactId>ant-contrib</artifactId> <version>1.0b3</version> <scope>compile</scope> </dependency> </dependencies> </plugin> {code} {code} (edited) [echo] plugin classpath: org/apache/maven/plugins/maven-antrun-plugin/1.6/maven-antrun-plugin-1.6.jar: org/apache/ant/ant-antunit/1.2/ant-antunit-1.2.jar: org/apache/ant/ant/1.7.1/ant-1.7.1.jar: org/apache/ant/ant-launcher/1.7.1/ant-launcher-1.7.1.jar: ant-contrib/ant-contrib/1.0b3/ant-contrib-1.0b3.jar: ant/ant/1.5/ant-1.5.jar: org/codehaus/plexus/plexus-interpolation/1.1/plexus-interpolation-1.1.jar: junit/junit/3.8.1/junit-3.8.1.jar:org/codehaus/plexus/plexus-utils/2.0.5/plexus-utils-2.0.5.jar: org/apache/ant/ant-nodeps/1.8.1/ant-nodeps-1.8.1.jar [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (reporting) on project jboss-as-testsuite-integration: An Ant BuildException has occured: The following error occurred while executing this line: [ERROR] Cause: the class org.apache.tools.ant.taskdefs.optional.junit.XMLResultAggregator was not found. {code} was (Author: ozizka): {code} <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-antrun-plugin</artifactId> <executions combine.children="append"> <execution> <id>reporting</id> <phase>compile</phase><!--post-integration-test--> <goals><goal>run</goal></goals> <configuration> <target> <property name="compile_classpath" refid="maven.compile.classpath"/> <property name="runtime_classpath" refid="maven.runtime.classpath"/> <property name="test_classpath" refid="maven.test.classpath"/> <property name="plugin_classpath" refid="maven.plugin.classpath"/> <echo message="compile classpath: ${compile_classpath}"/> <echo message="runtime classpath: ${runtime_classpath}"/> <echo message="test classpath: ${test_classpath}"/> <echo message="plugin classpath: ${plugin_classpath}"/> <ant antfile="${basedir}/../tools/report/buildReports.xml"> <!--<property name="reports.dest.dir" value=""/>--> <target name="reports"/> </ant> </target> </configuration> </execution> </executions> <dependencies> <dependency> <groupId>org.apache.ant</groupId> <artifactId>ant-antunit</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>ant-contrib</groupId> <artifactId>ant-contrib</artifactId> <version>1.0b3</version> <scope>compile</scope> </dependency> </dependencies> </plugin> {code} {code} [echo] plugin classpath: org/apache/maven/plugins/maven-antrun-plugin/1.6/maven-antrun-plugin-1.6.jar:org/apache/ant/ant-antunit/1.2/ant-antunit-1.2.jar:org/apache/ant/ant/1.7.1/ant-1.7.1.jar:org/apache/ant/ant-launcher/1.7.1/ant-launcher-1.7.1.jar:ant-contrib/ant-contrib/1.0b3/ant-contrib-1.0b3.jar:ant/ant/1.5/ant-1.5.jar:org/codehaus/plexus/plexus-interpolation/1.1/plexus-interpolation-1.1.jar:junit/junit/3.8.1/junit-3.8.1.jar:org/codehaus/plexus/plexus-utils/2.0.5/plexus-utils-2.0.5.jar:org/apache/ant/ant-nodeps/1.8.1/ant-nodeps-1.8.1.jar [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (reporting) on project jboss-as-testsuite-integration: An Ant BuildException has occured: The following error occurred while executing this line: [ERROR] Cause: the class org.apache.tools.ant.taskdefs.optional.junit.XMLResultAggregator was not found. {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka updated AS7-2011: ------------------------------ Comment: was deleted (was: {code} <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-antrun-plugin</artifactId> <executions combine.children="append"> <execution> <id>reporting</id> <phase>compile</phase><!--post-integration-test--> <goals><goal>run</goal></goals> <configuration> <target> <property name="compile_classpath" refid="maven.compile.classpath"/> <property name="runtime_classpath" refid="maven.runtime.classpath"/> <property name="test_classpath" refid="maven.test.classpath"/> <property name="plugin_classpath" refid="maven.plugin.classpath"/> <echo message="compile classpath: ${compile_classpath}"/> <echo message="runtime classpath: ${runtime_classpath}"/> <echo message="test classpath: ${test_classpath}"/> <echo message="plugin classpath: ${plugin_classpath}"/> <ant antfile="${basedir}/../tools/report/buildReports.xml"> <!--<property name="reports.dest.dir" value=""/>--> <target name="reports"/> </ant> </target> </configuration> </execution> </executions> <dependencies> <dependency> <groupId>org.apache.ant</groupId> <artifactId>ant-antunit</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>ant-contrib</groupId> <artifactId>ant-contrib</artifactId> <version>1.0b3</version> <scope>compile</scope> </dependency> </dependencies> </plugin> {code} {code} (edited) [echo] plugin classpath: org/apache/maven/plugins/maven-antrun-plugin/1.6/maven-antrun-plugin-1.6.jar: org/apache/ant/ant-antunit/1.2/ant-antunit-1.2.jar: org/apache/ant/ant/1.7.1/ant-1.7.1.jar: org/apache/ant/ant-launcher/1.7.1/ant-launcher-1.7.1.jar: ant-contrib/ant-contrib/1.0b3/ant-contrib-1.0b3.jar: ant/ant/1.5/ant-1.5.jar: org/codehaus/plexus/plexus-interpolation/1.1/plexus-interpolation-1.1.jar: junit/junit/3.8.1/junit-3.8.1.jar:org/codehaus/plexus/plexus-utils/2.0.5/plexus-utils-2.0.5.jar: org/apache/ant/ant-nodeps/1.8.1/ant-nodeps-1.8.1.jar [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (reporting) on project jboss-as-testsuite-integration: An Ant BuildException has occured: The following error occurred while executing this line: [ERROR] Cause: the class org.apache.tools.ant.taskdefs.optional.junit.XMLResultAggregator was not found. {code}) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka edited comment on AS7-2011 at 10/16/11 9:54 PM: ------------------------------------------------------------- Added dependency: {code} <dependency> <groupId>ant</groupId> <artifactId>ant-junit</artifactId> <version>1.6.5</version> </dependency> {code} was (Author: ozizka): Added dependency: {code} <dependency> <groupId>ant</groupId> <artifactId>ant-junit</artifactId> <version>1.6.5</version> </dependency> {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka resolved AS7-2011. ------------------------------- Resolution: Done Reused EAP 5 reports: https://github.com/OndraZizka/jboss-as/commits/test_reports -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka updated AS7-2011: ------------------------------ Attachment: JUnitDiff-two-runs-comparison.html We could also use JUnitDiff which produces reports like the one attached. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka commented on AS7-2011: ----------------------------------- Reporting itself is done. Now I am trying to position it well in the testsuite. I've tried: 1) Having in testsuite/pom.xml, bound to the site phase. This needs to run `mvn site` in a separate command, since with `mvn install site`, it would run before the submodules were run. 2) Having it in testsuite/reporting/pom.xml This way, it must be in a profile, in order to run it as last submodule. That blocks having it auto-activated since it's not possible to move auto-activated profiles after property-activated. Ideally, `mvn install site` should have reporting by default, `-DnoReport` should skip reporting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka commented on AS7-2011: ----------------------------------- Update: Even property activation does not make reporting module run last, regardless ordering of profiles in pom.xml. So it will be two commands in the end. (?) Only other way to handle this would be a new module in root, next to testsuite. Like Hibernate 3.6 had it. Is that acceptable? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka updated AS7-2011: ------------------------------ Attachment: 2011-11-01.07-40.zip Attaching sample report. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Ondrej Zizka updated AS7-2011: ------------------------------ Attachment: TSreport.log Merged, works fine, see attached TSreport.log -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/AS7-2011?page=com.atlassian.jira.plugin.s... ] Rostislav Svoboda commented on AS7-2011: ---------------------------------------- It runs during testsuite's "site" phase. So, for example this will give you reports in the AS7/testsuite/target/reports directory: {code} ./build.sh clean install -DallTests ./integration-tests.sh site {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira