[jbossts-issues] [JBoss JIRA] (JBTM-3137) Too much variance it the performance PR checker

[Michael Musgrove (Jira)]

Michael Musgrove created JBTM-3137:
--------------------------------------

             Summary: Too much variance it the performance PR checker
                 Key: JBTM-3137
                 URL: https://issues.jboss.org/browse/JBTM-3137
             Project: JBoss Transaction Manager
          Issue Type: Bug
          Components: Performance Testing
    Affects Versions: 5.9.5.Final
            Reporter: Michael Musgrove
            Assignee: Michael Musgrove
             Fix For: 5.next


The PERF axis of the PR checker job runs some tests to validate that the PR does not introduce any regressions but the axis is not useful since there is too much variance in the runs. For example PR https://github.com/jbosstm/narayana/pull/1437 ran 3 times each producing wildly different results.



--
This message was sent by Atlassian Jira
(v7.12.1#712002)