[infinispan-issues] [JBoss JIRA] (ISPN-6254) State transfer hangs after CacheNotFoundResponse

[Dan Berindei (JIRA)]

     [ https://issues.jboss.org/browse/ISPN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Berindei resolved ISPN-6254.
--------------------------------
    Resolution: Done


The warning was fixed with ISPN-6327.

> State transfer hangs after CacheNotFoundResponse
> ------------------------------------------------
>
>                 Key: ISPN-6254
>                 URL: https://issues.jboss.org/browse/ISPN-6254
>             Project: Infinispan
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 8.2.0.Beta2, 8.1.2.Final
>            Reporter: Dan Berindei
>            Assignee: Dan Berindei
>            Priority: Critical
>              Labels: testsuite_stability
>             Fix For: 8.2.0.Final, 8.2.0.CR1
>
>
> When {{StateConsumerImpl.addTransfer()}} sends a {{StateRequestCommand(START_STATE_TRANSFER)}}, it doesn't block the thread until it receives all the state (ISPN-5019). Instead, it calls {{SemaphoreCompletionService.continueTaskInBackground()}}, and then it calls {{SemaphoreCompletionService.backgroundTaskFinished()}} when it receives the response.
> However, if the request wasn't successful, e.g. because the node providing the state is shutting down and replies with a {{CacheNotFoundResponse}}, {{SemaphoreCompletionService.backgroundTaskFinished()}} isn't called, and state transfer cannot make any progress.
> This shows up in the test suite as random failures in {{NumOwnersNodeCrashInSequenceTest}} and {{NumOwnersNodeStopInSequenceTest}}:
> {noformat}
> 17:49:16,960 ERROR (testng-NumOwnersNodeCrashInSequenceTest:) [UnitTestTestNGListener] Test testNodeCrashedBeforeStFinished0(org.infinispan.partitionhandling.NumOwnersNodeCrashInSequenceTest) failed.
> org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.statetransfer.StateTransferManagerImpl.waitForInitialStateTransferToComplete() throws java.lang.Exception on object of type StateTransferManagerImpl
> 	at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:172) ~[infinispan-commons-8.2.0-SNAPSHOT.jar:8.2.0-SNAPSHOT]
> 	at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:887) ~[classes/:?]
> 	at org.infinispan.factories.AbstractComponentRegistry.invokeStartMethods(AbstractComponentRegistry.java:656) ~[classes/:?]
> 	at org.infinispan.factories.AbstractComponentRegistry.internalStart(AbstractComponentRegistry.java:645) ~[classes/:?]
> 	at org.infinispan.factories.AbstractComponentRegistry.start(AbstractComponentRegistry.java:548) ~[classes/:?]
> 	at org.infinispan.factories.ComponentRegistry.start(ComponentRegistry.java:222) ~[classes/:?]
> 	at org.infinispan.cache.impl.CacheImpl.start(CacheImpl.java:849) ~[classes/:?]
> 	at org.infinispan.manager.DefaultCacheManager.wireAndStartCache(DefaultCacheManager.java:624) ~[classes/:?]
> 	at org.infinispan.manager.DefaultCacheManager.createCache(DefaultCacheManager.java:577) ~[classes/:?]
> 	at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:445) ~[classes/:?]
> 	at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:431) ~[classes/:?]
> 	at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:413) ~[classes/:?]
> 	at org.infinispan.test.MultipleCacheManagersTest.getCaches(MultipleCacheManagersTest.java:211) ~[test-classes/:?]
> 	at org.infinispan.test.MultipleCacheManagersTest.waitForClusterToForm(MultipleCacheManagersTest.java:220) ~[test-classes/:?]
> 	at org.infinispan.test.MultipleCacheManagersTest.waitForClusterToForm(MultipleCacheManagersTest.java:229) ~[test-classes/:?]
> 	at org.infinispan.partitionhandling.NumOwnersNodeCrashInSequenceTest.testNodeCrashedBeforeStFinished(NumOwnersNodeCrashInSequenceTest.java:105) ~[test-classes/:?]
> 	at org.infinispan.partitionhandling.NumOwnersNodeCrashInSequenceTest.testNodeCrashedBeforeStFinished0(NumOwnersNodeCrashInSequenceTest.java:67) ~[test-classes/:?]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.11#64026)