[jbossts-issues] [JBoss JIRA] (JBTM-2301) PerformanceTest regression

[Tom Jenkinson (JIRA)]

    [ https://issues.jboss.org/browse/JBTM-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022422#comment-13022422 ] 

Tom Jenkinson commented on JBTM-2301:
-------------------------------------

It happened on code coverage run too: http://albany.eng.hst.ams2.redhat.com/view/Narayana+BlackTie/job/narayana-codeCoverage/156/console

I think we should disable this on the code coverage runs

> PerformanceTest regression
> --------------------------
>
>                 Key: JBTM-2301
>                 URL: https://issues.jboss.org/browse/JBTM-2301
>             Project: JBoss Transaction Manager
>          Issue Type: Bug
>          Components: Performance Testing
>            Reporter: Gytis Trikleris
>            Assignee: Michael Musgrove
>            Priority: Minor
>             Fix For: 5.0.4
>
>
> http://albany.eng.hst.ams2.redhat.com/view/Status/job/narayana/693/PROFILE=MAIN,jdk=jdk7.latest,label=linux/
> {code}
> -------------------------------------------------------------------------------
> Test set: io.narayana.perf.PerformanceTest
> -------------------------------------------------------------------------------
> Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 72.898 sec <<< FAILURE!
> regressionTest(io.narayana.perf.PerformanceTest)  Time elapsed: 6.268 sec  <<< FAILURE!
> junit.framework.AssertionFailedError: There should have been a perf regression
> 	at junit.framework.Assert.fail(Assert.java:57)
> 	at junit.framework.Assert.assertTrue(Assert.java:22)
> 	at junit.framework.TestCase.assertTrue(TestCase.java:192)
> 	at io.narayana.perf.PerformanceTest.regressionTest(PerformanceTest.java:296)
> {code}
> {code}
> Test Run: testTimeout (200 calls using 2 threads)
> ExecutionException exception: java.util.concurrent.BrokenBarrierException
> ExecutionException exception: java.util.concurrent.BrokenBarrierException
> testTimeout: 0.000000 calls / second (200 calls in 0 ms using 2 threads. 201 errors)
> Test Run:  (100000 calls using 10 threads)
> TestPerformance for 100000!: 17164.435290 calls / second (total time: 5826 ms versus 46786 ms)
> Test Run:  (1 calls using 1 threads)
> testSingleCall!: 1000.000000 calls / second (1 calls in 1 ms using 1 threads. 0 errors)
> Test Run:  (10000 calls using 10 threads)
> perfTest!: 4268.032437 calls / second (10000 calls in 2343 ms using 10 threads. 0 errors)
> Test Run:  (100 calls using 2 threads)
> java.lang.RuntimeException: Testing throw exception
> 	at io.narayana.perf.PerformanceTest$7.doWork(PerformanceTest.java:412)
> 	at io.narayana.perf.PerformanceTest$7.doWork(PerformanceTest.java:406)
> 	at io.narayana.perf.Measurement$1.call(Measurement.java:339)
> 	at io.narayana.perf.Measurement$1.call(Measurement.java:324)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:744)
> testCancelOnException!: 33333.333333 calls / second (100 calls in 3 ms using 2 threads. 20 errors)
> Test Run: io.narayana.perf.PerformanceTest_regressionTest (10000 calls using 10 threads)
> Test Run: io.narayana.perf.PerformanceTest_regressionTest (10000 calls using 10 threads)
> Test Run:  (1000 calls using 10 threads)
> testAbortMeasurement2: 0.000000 calls / second (1000 calls in 0 ms using 10 threads. 11 errors)
> Test Warm Up: io.narayana.perf.PerformanceTest_readPerfArgsTest: (10 calls using 50 threads)
> Test Run: io.narayana.perf.PerformanceTest_readPerfArgsTest (1000000 calls using 50 threads)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.8#6338)