[jbossts-issues] [JBoss JIRA] (JBTM-1763) Consider running the QA tests in parrallel

[Paul Robinson (JIRA)]

    [ https://issues.jboss.org/browse/JBTM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784760#comment-12784760 ] 

Paul Robinson commented on JBTM-1763:
-------------------------------------

This is just one possible solution to the problem of the long test duration. We should wait for JBTM-1808 before deciding what to do with this issue.
                
> Consider running the QA tests in parrallel
> ------------------------------------------
>
>                 Key: JBTM-1763
>                 URL: https://issues.jboss.org/browse/JBTM-1763
>             Project: JBoss Transaction Manager
>          Issue Type: Feature Request
>      Security Level: Public(Everyone can see) 
>          Components: Testing
>            Reporter: Paul Robinson
>            Assignee: Tom Jenkinson
>            Priority: Minor
>             Fix For: 5.0.0.M4
>
>
> The QA tests currently take 5hrs to run per orb. This constitutes 83% of our CI run time. 
> My understanding is that the time is mostly taken up in Thread.sleep. The test times range from 1 to 99seconds. So there are no major hotspots. The problem is that there are so many tests.
> I suspect we could run these tests in parallel to make better utilisation of resources.
> The tests don't run in an AS, but they do acquire ports. There may be other restrictions that make running them in parallel hard or impossible.
> It would be easier to simply carve up the tests into, say 5 parts per orb and have CI do the parallelism. However, this will consume more CI nodes than if we ran them in parallel on a single node.
> I think it would be worth investigating if we can run the tests in n batches (say n=10 initially, but should be configurable). Where each batch runs with a different port configuration. This may prove too disruptive to the tests, 
> and also more bother than it is worth. Maybe we could do an initial investigation to see if this has legs?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira