[jboss-jira] [JBoss JIRA] (AS7-2009) TS: Compare sets of tests run in both versions for respective groups

[Ondrej Zizka (Commented) (JIRA)]

    [ https://issues.jboss.org/browse/AS7-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632685#comment-12632685 ] 

Ondrej Zizka commented on AS7-2009:
-----------------------------------

I've changed the scripts - introduced a shared test group definition file groupDefs.sh.
Windows TBD.

Current behavior:
{code}
$ ./build.sh clean install
/home/ondra/work/AS7/jboss-as/tools/maven/bin/mvn -s tools/maven/conf/settings.xml clean install -Dintegration.module -Dsmoke.integration.tests

$ ./build.sh clean install -DallTests
/home/ondra/work/AS7/jboss-as/tools/maven/bin/mvn -s tools/maven/conf/settings.xml clean install -DallTests -Dintegration.module -Dbasic.integration.tests -Dcompat.integration.tests -Dclustering.integration.tests -Dtimerservice.integration.tests -Dapi.module -Dspec.module -Ddomain.module
{code}
                
> TS: Compare sets of tests run in both versions for respective groups
> --------------------------------------------------------------------
>
>                 Key: AS7-2009
>                 URL: https://issues.jboss.org/browse/AS7-2009
>             Project: Application Server 7
>          Issue Type: Sub-task
>          Components: Test Suite
>            Reporter: Ondrej Zizka
>            Assignee: Ondrej Zizka
>
> Make sure that the set of tests run by the modified testsuite is the
> same as the set of tests run by the unmodified testsuite (this is
> because the includes/excludes have been rearranged in some cases,
> especially in the integration module).
> {code}
> COMB="new-DallTests-clean"
> DIR=~/work/AS7/TS-compare/$COMB
> mkdir -p $DIR/allReports
> find testsuite/ -name TEST-* > $DIR/list.txt
> for i in `find testsuite/ -name *TestCase*.txt`; do cp $i $DIR/allReports ; done
> for i in `find testsuite/ -name TEST-*`;         do cp $i $DIR/allReports ; done
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira