]
Dan Berindei commented on ISPN-7022:
------------------------------------
Looking closer, none of the recent failures have the stack trace in the description. Most
of them are caused by ISPN-9099, only one of them is different:
{noformat}
[ERROR]
testSplitAndMerge3[DIST_SYNC](org.infinispan.partitionhandling.TwoWaySplitAndMergeTest)
Time elapsed: 0.031 s <<< FAILURE!
java.lang.AssertionError: Sets differ: expected
[TwoWaySplitAndMergeTest[DIST_SYNC]-NodeC-27237,
TwoWaySplitAndMergeTest[DIST_SYNC]-NodeD-27548,
TwoWaySplitAndMergeTest[DIST_SYNC]-NodeB-35865,
TwoWaySplitAndMergeTest[DIST_SYNC]-NodeA-35488] but got
[TwoWaySplitAndMergeTest[DIST_SYNC]-NodeC-27237,
TwoWaySplitAndMergeTest[DIST_SYNC]-NodeB-35865,
TwoWaySplitAndMergeTest[DIST_SYNC]-NodeA-35488]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.assertEquals(Assert.java:808)
at org.testng.Assert.assertEquals(Assert.java:786)
at
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge(TwoWaySplitAndMergeTest.java:69)
at
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge3(TwoWaySplitAndMergeTest.java:39)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:639)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:816)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1124)
at
org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
at org.testng.TestRunner.privateRun(TestRunner.java:774)
at org.testng.TestRunner.run(TestRunner.java:624)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:359)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:39)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:393)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{noformat}
Stable topology updates are sent asynchronously after the {{NO_REBALANCE}} topology update
is sent at the end of the rebalance, so it's always a good idea to use
{{eventuallyEquals}} when it comes to the stable topology.
TwoWaySplitAndMergeTest.testSplitAndMerge2 fails
------------------------------------------------
Key: ISPN-7022
URL:
https://issues.jboss.org/browse/ISPN-7022
Project: Infinispan
Issue Type: Bug
Affects Versions: 9.2.1.Final
Reporter: Sebastian Ćaskawiec
Assignee: Dan Berindei
Fix For: 9.3.0.Beta1
http://ci.infinispan.org/viewLog.html?buildId=42202&tab=buildResultsD...
{noformat}
java.lang.AssertionError:
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:235)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:217)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:193)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:527)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest.access$600(BasePartitionHandlingTest.java:44)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest$Partition.assertAvailabilityMode(BasePartitionHandlingTest.java:328)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest$Partition.assertDegradedMode(BasePartitionHandlingTest.java:265)
at
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge(TwoWaySplitAndMergeTest.java:74)
at
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge2(TwoWaySplitAndMergeTest.java:26)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
------- Stdout: -------
13:26:54,221 ERROR (testng-DelayedAvailabilityUpdateTest) [InvocationContextInterceptor]
ISPN000136: Error executing command GetKeyValueCommand, writing keys []
org.infinispan.partitionhandling.AvailabilityException: ISPN000306: Key
'MagicKey#k1Existing{1420/A1FBD015/225@DelayedAvailabilityUpdateTest-NodeT-8452}'
is not available. Not all owners are in this partition
at
org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl.doCheck(PartitionHandlingManagerImpl.java:250)
at
org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl.checkRead(PartitionHandlingManagerImpl.java:102)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.postOperationPartitionCheck(PartitionHandlingInterceptor.java:188)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.lambda$handleDataReadCommand$412(PartitionHandlingInterceptor.java:145)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor$$Lambda$1639/1963537113.handle(Unknown
Source)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlerSync(BaseAsyncInvocationContext.java:493)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlersSync(BaseAsyncInvocationContext.java:125)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.forkInvocationSync(BaseAsyncInvocationContext.java:99)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeForkAndHandlerSync(BaseAsyncInvocationContext.java:474)[TestSuiteProgress]
Test failed:
org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringCommitTest.testOriginatorIsolatedPartition
13:26:54,221 ERROR (testng-OptimisticTxPartitionAndMergeDuringCommitTest)
[TestSuiteProgress] Test failed:
org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringCommitTest.testOriginatorIsolatedPartition
java.lang.AssertionError: There are pending transactions!
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:235)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:531)
at
org.infinispan.test.MultipleCacheManagersTest.assertNoTransactions(MultipleCacheManagersTest.java:794)
at
org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest.finalAsserts(BaseTxPartitionAndMergeTest.java:96)
at
org.infinispan.partitionhandling.BaseOptimisticTxPartitionAndMergeTest.doTest(BaseOptimisticTxPartitionAndMergeTest.java:77)
at
org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringCommitTest.testOriginatorIsolatedPartition(OptimisticTxPartitionAndMergeDuringCommitTest.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[TestSuiteProgress]
Tests succeeded: 6704, failed: 1, skipped: 0
13:26:54,222 ERROR (testng-DelayedAvailabilityUpdateTest) [InvocationContextInterceptor]
ISPN000136: Error executing command GetKeyValueCommand, writing keys []
org.infinispan.partitionhandling.AvailabilityException: ISPN000306: Key
'MagicKey#k2Existing{1421/89F8758B/114@DelayedAvailabilityUpdateTest-NodeQ-17336}'
is not available. Not all owners are in this partition
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.postOperationPartitionCheck(PartitionHandlingInterceptor.java:197)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.lambda$handleDataReadCommand$412(PartitionHandlingInterceptor.java:145)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor$$Lambda$1639/1963537113.handle(Unknown
Source)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlerSync(BaseAsyncInvocationContext.java:493)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlersSync(BaseAsyncInvocationContext.java:125)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.forkInvocationSync(BaseAsyncInvocationContext.java:99)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeForkAndHandlerSync(BaseAsyncInvocationContext.java:474)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.afterVisit(BaseAsyncInvocationContext.java:463)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeInterceptorsSync(BaseAsyncInvocationContext.java:322)13:26:54,222
ERROR (testng-DelayedAvailabilityUpdateTest) [InvocationContextInterceptor] ISPN000136:
Error executing command GetKeyValueCommand, writing keys []
org.infinispan.partitionhandling.AvailabilityException: ISPN000306: Key
'MagicKey#k2Existing{1421/89F8758B/114@DelayedAvailabilityUpdateTest-NodeQ-17336}'
is not available. Not all owners are in this partition
at
org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl.doCheck(PartitionHandlingManagerImpl.java:250)
at
org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl.checkRead(PartitionHandlingManagerImpl.java:102)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.postOperationPartitionCheck(PartitionHandlingInterceptor.java:188)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.lambda$handleDataReadCommand$412(PartitionHandlingInterceptor.java:145)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor$$Lambda$1639/1963537113.handle(Unknown
Source)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlerSync(BaseAsyncInvocationContext.java:493)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeReturnHandlersSync(BaseAsyncInvocationContext.java:125)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.forkInvocationSync(BaseAsyncInvocationContext.java:99)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeForkAndHandlerSync(BaseAsyncInvocationContext.java:474)13:26:49,964
ERROR (transport-thread-PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-p44001-t2)
[CLUSTER] [Context=pes-cache]ISPN000319: After merge (or coordinator change), cache still
hasn't recovered all its data and must stay in degraded mode. Current members are
[PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-37404,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeH-18972], lost members are
[PessimisticTxPartitionAndMergeDuringPrepareTest-NodeE-27252,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeF-47835], stable members are
[PessimisticTxPartitionAndMergeDuringPrepareTest-NodeE-27252,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeF-47835,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-37404,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeH-18972]
[TestSuiteProgress] Test failed:
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge2
13:26:55,721 ERROR (testng-TwoWaySplitAndMergeTest) [TestSuiteProgress] Test failed:
org.infinispan.partitionhandling.TwoWaySplitAndMergeTest.testSplitAndMerge2
java.lang.AssertionError:
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:235)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:217)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:193)
at
org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:527)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest.access$600(BasePartitionHandlingTest.java:44)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest$Partition.assertAvailabilityMode(BasePartitionHandlingTest.java:328)
at
org.infinispan.partitionhandling.BasePartitionHandlingTest$Partition.assertDegradedMode(BasePartitionHandlingTest.java:265)13:26:49,964
ERROR (transport-thread-PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-p44001-t3)
[CLUSTER] [Context=___defaultcache]ISPN000319: After merge (or coordinator change), cache
still hasn't recovered all its data and must stay in degraded mode. Current members
are [PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-37404,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeH-18972], lost members are
[PessimisticTxPartitionAndMergeDuringPrepareTest-NodeE-27252,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeF-47835], stable members are
[PessimisticTxPartitionAndMergeDuringPrepareTest-NodeE-27252,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeF-47835,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeG-37404,
PessimisticTxPartitionAndMergeDuringPrepareTest-NodeH-18972]
[TestSuiteProgress] Tests succeeded: 6704, failed: 2, skipped: 0
13:26:55,095 ERROR (testng-OptimisticTxPartitionAndMergeDuringPrepareTest)
[InvocationContextInterceptor] ISPN000136: Error executing command ClearCommand, writing
keys []
org.infinispan.partitionhandling.AvailabilityException: ISPN000307: Cannot clear when the
cluster is partitioned
at
org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl.checkClear(PartitionHandlingManagerImpl.java:108)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.visitClearCommand(PartitionHandlingInterceptor.java:95)
at
org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor.visitClearCommand(PartitionHandlingInterceptor.java:38)
at org.infinispan.commands.write.ClearCommand.acceptVisitor(ClearCommand.java:44)
at
org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:53)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeInterceptorsSync(BaseAsyncInvocationContext.java:307)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.forkInvocationSync(BaseAsyncInvocationContext.java:98)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.invokeForkAndHandlerSync(BaseAsyncInvocationContext.java:474)
at
org.infinispan.interceptors.impl.BaseAsyncInvocationContext.afterVisit(BaseAsyncInvocationContext.java:463)
{noformat}