[infinispan-issues] [JBoss JIRA] (ISPN-5123) MultiNodeDistributedTest dealock

[Gustavo Fernandes (JIRA)]

    [ https://issues.jboss.org/browse/ISPN-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030583#comment-13030583 ] 

Gustavo Fernandes commented on ISPN-5123:
-----------------------------------------

After 30min, the exception is logged:

{code}
Tests run: 1844, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2,017.689 sec <<< FAILURE! - in TestSuite
testIndexingWorkDistribution(org.infinispan.query.distributed.MultiNodeDistributedTest)  Time elapsed: 1,963.317 sec  <<< FAILURE!
java.lang.RuntimeException: Timed out waiting for rebalancing to complete on node MultiNodeDistributedTest-NodeB-61010, current topology is CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns = 60, owners = (3)[MultiNodeDistributedTest-NodeB-61010: 23+7, MultiNodeDistributedTest-NodeC-41016: 18+12, MultiNodeDistributedTest-NodeD-40175: 19+11]}, pendingCH=DefaultConsistentHash{ns = 60, owners = (3)[MultiNodeDistributedTest-NodeB-61010: 20+20, MultiNodeDistributedTest-NodeC-41016: 20+20, MultiNodeDistributedTest-NodeD-40175: 20+20]}, unionCH=DefaultConsistentHash{ns = 60, owners = (3)[MultiNodeDistributedTest-NodeB-61010: 23+17, MultiNodeDistributedTest-NodeC-41016: 18+23, MultiNodeDistributedTest-NodeD-40175: 19+23]}, actualMembers=[MultiNodeDistributedTest-NodeB-61010, MultiNodeDistributedTest-NodeC-41016, MultiNodeDistributedTest-NodeD-40175]}. rebalanceInProgress=true, currentChIsBalanced=false
        at org.infinispan.test.TestingUtil.waitForRehashToComplete(TestingUtil.java:239)
        at org.infinispan.test.TestingUtil.waitForRehashToComplete(TestingUtil.java:249)
        at org.infinispan.query.helper.TestableCluster.waitForRehashToComplete(TestableCluster.java:62)
        at org.infinispan.query.helper.TestableCluster.killNode(TestableCluster.java:57)
        at org.infinispan.query.distributed.MultiNodeDistributedTest.killMasterNode(MultiNodeDistributedTest.java:79)
        at org.infinispan.query.distributed.MultiNodeDistributedTest.testIndexingWorkDistribution(MultiNodeDistributedTest.java:63)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
        at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
        at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
        at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
        at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
        at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
        at org.testng.TestRunner.privateRun(TestRunner.java:767)
        at org.testng.TestRunner.run(TestRunner.java:617)
        at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
        at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
        at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
        at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
{code}

> MultiNodeDistributedTest dealock
> --------------------------------
>
>                 Key: ISPN-5123
>                 URL: https://issues.jboss.org/browse/ISPN-5123
>             Project: Infinispan
>          Issue Type: Bug
>          Components: Test Suite - Query
>    Affects Versions: 7.1.0.Alpha1
>            Reporter: Gustavo Fernandes
>         Attachments: stack.zip
>
>
> I've been seeing this intermittent problem in my environment. Sometimes the query suite hangs for 30min (and then proceeds). See attached stack trace.



--
This message was sent by Atlassian JIRA
(v6.3.11#6341)