[jbossts-issues] [JBoss JIRA] (JBTM-1453) Reinstate/review the numbers to detect performance regressions

[Michael Musgrove (JIRA)]

    [ https://issues.jboss.org/browse/JBTM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979288#comment-12979288 ] 

Michael Musgrove commented on JBTM-1453:
----------------------------------------

I have added RTS and CMR (and the two orbs) into the mix.

To enable regression testing the job needs to set a system property to indicate the directory where the performance figures are stored (performanceprofilestore).
A test that exposes a  regression of more that 10% will fail the build. The variance can be changed via another system property. Here is an example that allows a 100% variance (-Dio.narayana.perf.PerformanceVariance=2.0):

./build.sh -f rts/at/tx/pom.xml test -Dtest=org.jboss.jbossts.star.test.PerformanceTest -Dperformanceprofilestore.dir=$WORKSPACE/qa/config/perf_profiles -Dio.narayana.perf.PerformanceVariance=2.0

> Reinstate/review the numbers to detect performance regressions
> --------------------------------------------------------------
>
>                 Key: JBTM-1453
>                 URL: https://issues.jboss.org/browse/JBTM-1453
>             Project: JBoss Transaction Manager
>          Issue Type: Task
>      Security Level: Public(Everyone can see) 
>          Components: Performance Testing
>            Reporter: Tom Jenkinson
>            Assignee: Michael Musgrove
>             Fix For: 5.0.3
>
>   Original Estimate: 3 days
>  Remaining Estimate: 3 days
>




--
This message was sent by Atlassian JIRA
(v6.2.6#6264)