[jbossts-issues] [JBoss JIRA] (JBTM-1453) Reinstate/review the numbers to detect performance regressions

Michael Musgrove (JIRA) jira-events at lists.jboss.org
Mon Sep 2 06:09:03 EDT 2013


    [ https://issues.jboss.org/browse/JBTM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800861#comment-12800861 ] 

Michael Musgrove commented on JBTM-1453:
----------------------------------------

Currently I am running the job once a week (it takes about 40 minutes) on dedicated hardware (haverstraw) and the job looks for regressions of more than 10% against a standard set of timings. These standard figures are old so need updating to use the actual figures for a run on our chosen dedicated hardware.

What I can do is add a set of expected timings for each slave in our CI cluster so that we can run the performance tests as part of every PR. Even though most slaves are VMs running on shared physical hardware I believe the actual timings will not be skewed if the other VMs are running because each VM is separately provisioned.
                
> Reinstate/review the numbers to detect performance regressions
> --------------------------------------------------------------
>
>                 Key: JBTM-1453
>                 URL: https://issues.jboss.org/browse/JBTM-1453
>             Project: JBoss Transaction Manager
>          Issue Type: Task
>      Security Level: Public(Everyone can see) 
>          Components: Performance Testing
>            Reporter: Tom Jenkinson
>            Assignee: Michael Musgrove
>            Priority: Minor
>             Fix For: 5.0.0.Final
>
>   Original Estimate: 3 days
>  Remaining Estimate: 3 days
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


More information about the jbossts-issues mailing list