[jboss-jira] [JBoss JIRA] (AS7-2270) TS: Define testsuite acceptance test (a testsuite for the testsuite)

[Ondrej Zizka (JIRA)]

     [ https://issues.jboss.org/browse/AS7-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ondrej Zizka resolved AS7-2270.
-------------------------------

    Resolution: Partially Completed


Kind of: https://hudson.qa.jboss.com/hudson/job/AS7-TS-valid/
                
> TS: Define testsuite acceptance test (a testsuite for the testsuite)
> --------------------------------------------------------------------
>
>                 Key: AS7-2270
>                 URL: https://issues.jboss.org/browse/AS7-2270
>             Project: Application Server 7
>          Issue Type: Sub-task
>          Components: Test Suite
>            Reporter: Ondrej Zizka
>            Assignee: Ondrej Zizka
>             Fix For: 7.1.1.Final
>
>
> Define a procedure to perform before committing something to the testsuite.
> Create scripts to help determining whether given testsuite is okay to be committed.
> E.g.
> {code}
> IN='-DallTests -Dinteg-tests -Dcluster-tests -Dbasic-tests -Dbenchmark-tests -Dsmoke-tests -Dstress-tests -Ddomain-tests -Dcompat-tests';
> for GROUP in $(echo $IN | tr ";" "\n"); do
>   ## Create results dir.
>   RES_DIR=~/work/AS7/res/$GROUP
>   mkdir -p $RES_DIR
>   ## Run the testsuite.
>   ./integration-tests.sh clean -DallTests;
>   ./integration-tests.sh install $GROUP;
>   ## Archive the reports.
>   for REPORT in `find testsuite -name 'TEST-*.xml' -or -name '*TestCase.txt' -or -name '*TestCase-output.txt'`; do
>     SUB_DIR=`dirname $REPORT | sed 's#testsuite/##' | sed 's#/target/surefire-reports##'`
>     mkdir -p $RES_DIR/$SUB_DIR
>     cp $REPORT $RES_DIR/$SUB_DIR
>   done
>   ## Run the testsuite for 2nd time to ensure that unclean run works too.
>   ./integration-tests.sh install $GROUP;
> done
> ## Create a JUnitDiff report.
> {code}
> Also, check what's being passed to `mvn` on various params combinations:
> {code}
> ./build.sh -DallTests
> ./build.sh -DallTests -Dfoo
> ./build.sh install -DallTests
> ./build.sh clean -DallTests
> ./build.sh clean install -DallTests -Dfoo
> ./integration-tests.sh -DallTests;
> ./integration-tests.sh install -DallTests;
> ./integration-tests.sh clean -DallTests;
> ./integration-tests.sh clean install -DallTests -Dfoo;
> ./integration-tests.sh test -DallTests -Dfoo;
> ...
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira