Diego Lovison created ISPN-9239: ----------------------------------- Summary: WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer random failures Key: ISPN-9239 URL: https://issues.jboss.org/browse/ISPN-9239 Project: Infinispan Issue Type: Bug Components: Test Suite - Core Affects Versions: 9.2.0.CR1 Reporter: Diego Lovison Assignee: Dan Berindei Priority: Critical Fix For: 9.2.0.CR2 Most likely the {{BlockingLocalTopologyManager}} blocks state transfer for the {{CONFIG}} cache and that prevents the {{CONFIG}} entry iterator from finishing: {noformat} 19:39:52,601 TRACE (testng-Test:[]) [DistributedCacheStream] Distributed iterator invoked with rehash: true 19:39:52,611 TRACE (testng-Test:[]) [ClusterStreamManagerImpl] Request: Test-NodeC-6083-1 is requesting 512 more entries from Test-NodeA-10673={0-3 5-6 12 14 16 18 20 22 25 27-28 30 33 37 39 41 43-46 48 50 52 57-58 64-70 72-77 80 82-83 85-87 89-91 94 97-99 102 106-107 111-112 116 118 121 124 129 131 134 136-140 142-144 147-148 154 156-161 164-167 170 173-180 183 185 187-189 194-195 199-202 204 207 210-212 214 216-217 219 222 230 232-234 238 240-242 245-246 248 253-254} in segments {0-3 5-6 12 14 16 18 20 22 25 27-28 30 33 37 39 41 43-46 48 50 52 57-58 64-70 72-77 80 82-83 85-87 89-91 94 97-99 102 106-107 111-112 116 118 121 124 129 131 134 136-140 142-144 147-148 154 156-161 164-167 170 173-180 183 185 187-189 194-195 199-202 204 207 210-212 214 216-217 219 222 230 232-234 238 240-242 245-246 248 253-254} 19:39:52,611 TRACE (testng-Test:[]) [JGroupsTransport] Test-NodeC-6083 sending request 4 to Test-NodeA-10673: StreamIteratorRequestCommand{cacheName='org.infinispan.CONFIG'} 19:40:22,821 DEBUG (testng-Test:[]) [PriorityMergingProcessor] Timeout encountered: signaled false, error null, queues [QueueSubscriber{queue.empty = true, done = true}, QueueSubscriber{queue.empty = true, done = false}, QueueSubscriber{queue.empty = true, done = true}] 19:40:22,892 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer org.infinispan.manager.EmbeddedCacheManagerStartupException: org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart() on object of type GlobalConfigurationManagerImpl at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:271) ~[classes/:?] at org.infinispan.manager.DefaultCacheManager.start(DefaultCacheManager.java:671) ~[classes/:?] at org.infinispan.test.MultipleCacheManagersTest.addClusterEnabledCacheManager(MultipleCacheManagersTest.java:223) ~[test-classes/:?] at org.infinispan.test.MultipleCacheManagersTest.addClusterEnabledCacheManager(MultipleCacheManagersTest.java:205) ~[test-classes/:?] at org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.addNode(WriteSkewDuringStateTransferTest.java:173) ~[test-classes/:?] at org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer(WriteSkewDuringStateTransferTest.java:96) ~[test-classes/:?] Caused by: org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart() on object of type GlobalConfigurationManagerImpl at org.infinispan.commons.util.SecurityActions.lambda$invokeAccessibly$0(SecurityActions.java:83) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.SecurityActions.doPrivileged(SecurityActions.java:71) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.SecurityActions.invokeAccessibly(SecurityActions.java:76) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:185) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:968) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.lambda$invokePrioritizedMethods$6(AbstractComponentRegistry.java:703) ~[classes/:?] at org.infinispan.factories.SecurityActions.lambda$run$1(SecurityActions.java:72) ~[classes/:?] at org.infinispan.security.Security.doPrivileged(Security.java:76) ~[classes/:?] at org.infinispan.factories.SecurityActions.run(SecurityActions.java:71) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.invokePrioritizedMethods(AbstractComponentRegistry.java:696) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.postStart(AbstractComponentRegistry.java:620) ~[classes/:?] at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:267) ~[classes/:?] ... 25 more Caused by: org.infinispan.util.concurrent.TimeoutException at org.infinispan.stream.impl.PriorityMergingProcessor$MultiSubscriberIterator.getNext(PriorityMergingProcessor.java:179) ~[classes/:?] at org.infinispan.commons.util.AbstractIterator.hasNext(AbstractIterator.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.stream.impl.DistributedCacheStream$RehashIterator.getNext(DistributedCacheStream.java:624) ~[classes/:?] at org.infinispan.commons.util.AbstractIterator.hasNext(AbstractIterator.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.RemovableIterator.getNextFromIterator(RemovableIterator.java:27) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.RemovableIterator.hasNext(RemovableIterator.java:36) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.Closeables$IteratorAsCloseableIterator.hasNext(Closeables.java:116) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.RemovableIterator.getNextFromIterator(RemovableIterator.java:27) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.RemovableIterator.hasNext(RemovableIterator.java:36) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.IteratorMapper.hasNext(IteratorMapper.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.EncoderCache$EncoderIterator.hasNext(EncoderCache.java:727) ~[classes/:?] at org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart(GlobalConfigurationManagerImpl.java:74) ~[classes/:?] at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source) ~[?:?] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_152] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_152] at org.infinispan.commons.util.SecurityActions.lambda$invokeAccessibly$0(SecurityActions.java:79) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.SecurityActions.doPrivileged(SecurityActions.java:71) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.SecurityActions.invokeAccessibly(SecurityActions.java:76) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:185) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:968) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.lambda$invokePrioritizedMethods$6(AbstractComponentRegistry.java:703) ~[classes/:?] at org.infinispan.factories.SecurityActions.lambda$run$1(SecurityActions.java:72) ~[classes/:?] at org.infinispan.security.Security.doPrivileged(Security.java:76) ~[classes/:?] at org.infinispan.factories.SecurityActions.run(SecurityActions.java:71) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.invokePrioritizedMethods(AbstractComponentRegistry.java:696) ~[classes/:?] at org.infinispan.factories.AbstractComponentRegistry.postStart(AbstractComponentRegistry.java:620) ~[classes/:?] at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:267) ~[classes/:?] ... 25 more {noformat} -- This message was sent by Atlassian JIRA (v7.5.0#75005)