Dan Berindei created ISPN-6983: ---------------------------------- Summary: ThreeNodesSplitAndMergeTest random failures Key: ISPN-6983 URL: https://issues.jboss.org/browse/ISPN-6983 Project: Infinispan Issue Type: Bug Components: Core, Test Suite - Core Affects Versions: 9.0.0.Alpha4 Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 9.0.0.Beta1 When merging the partitions, the stable topology is updated last. So when the merge is done and the cache is balanced, we cannot assume that the stable topology was updated already: {noformat} 10:31:19,576 INFO (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [CLUSTER] ISPN000336: Finished cluster-wide rebalance for cache ___defaultcache, topology id = 12 10:31:19,578 DEBUG (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}, availability mode = AVAILABLE 10:31:19,579 DEBUG (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]} 10:31:19,579 TRACE (transport-thread-TNRSAMT-NodeD-p47037-t3:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]} 10:31:19,581 TRACE (OOB-2,TNRSAMT-NodeE-56471:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=TNRSAMT-NodeD-51650, joinInfo=null, topologyId=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], throwable=null, viewId=15} [sender=TNRSAMT-NodeD-51650] 10:31:19,590 TRACE (OOB-2,TNRSAMT-NodeE-56471:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=TNRSAMT-NodeD-51650, joinInfo=null, topologyId=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, availabilityMode=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], throwable=null, viewId=15} [sender=TNRSAMT-NodeD-51650] 10:31:19,591 ERROR (testng-TNRSAMT:[]) [TestSuiteProgress] Test failed: org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge1 java.lang.AssertionError: Sets differ: expected [TNRSAMT-NodeD-51650, TNRSAMT-NodeE-56471, TNRSAMT-NodeF-19367] but got [TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367] at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?] at org.testng.Assert.assertEquals(Assert.java:806) ~[testng-6.8.8.jar:?] at org.testng.Assert.assertEquals(Assert.java:784) ~[testng-6.8.8.jar:?] at org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge(ThreeNodesSplitAndMergeTest.java:106) ~[test-classes/:?] at org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge1(ThreeNodesSplitAndMergeTest.java:29) ~[test-classes/:?] 10:31:19,595 TRACE (transport-thread-TNRSAMT-NodeF-p47149-t1:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]} 10:31:19,596 TRACE (transport-thread-TNRSAMT-NodeE-p47049-t6:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]} {noformat} -- This message was sent by Atlassian JIRA (v6.4.11#64026)