[
https://issues.jboss.org/browse/ISPN-2752?page=com.atlassian.jira.plugin....
]
Dan Berindei commented on ISPN-2752:
------------------------------------
[~mircea.markus], the exception message "Remote (node0005/default) failed
unexpectedly" is misleading. In fact the coordinator is shutting down shortly after
it became coordinator, and while an asynchronous listener thread is trying to retrieve the
status in the cluster, the JChannel was closed and it also closed all pending (outgoing)
requests with an IllegalStateException.
Since the exception is local to the coordinator, which is already shutting down, this is
not going to impact anything. We could probably add a check when catching this exception
and skip logging it if the cache manager is shutting down.
IllegalStateException on shutdown
---------------------------------
Key: ISPN-2752
URL:
https://issues.jboss.org/browse/ISPN-2752
Project: Infinispan
Issue Type: Bug
Affects Versions: 5.2.0.CR2
Reporter: Michal Linhard
Assignee: Dan Berindei
Priority: Minor
Fix For: 5.2.1, 5.3.0.Final
This happens on graceful shutdown of 8 or 6 nodes of 5.2.0.CR2:
{code}
07:17:45,892 ERROR [org.infinispan.topology.ClusterTopologyManagerImpl] ISPN000196:
Failed to recover cluster state after the current node became the coordinator:
java.util.concurrent.ExecutionException: org.infinispan.CacheException: Remote
(node0005/default) failed unexpectedly
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:232) [rt.jar:1.6.0_33]
at java.util.concurrent.FutureTask.get(FutureTask.java:91) [rt.jar:1.6.0_33]
at
org.infinispan.topology.ClusterTopologyManagerImpl.executeOnClusterSync(ClusterTopologyManagerImpl.java:567)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.topology.ClusterTopologyManagerImpl.recoverClusterStatus(ClusterTopologyManagerImpl.java:432)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.topology.ClusterTopologyManagerImpl.handleNewView(ClusterTopologyManagerImpl.java:231)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener.handleViewChange(ClusterTopologyManagerImpl.java:597)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.6.0_33]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[rt.jar:1.6.0_33]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[rt.jar:1.6.0_33]
at java.lang.reflect.Method.invoke(Method.java:597) [rt.jar:1.6.0_33]
at
org.infinispan.notifications.AbstractListenerImpl$ListenerInvocation$1.run(AbstractListenerImpl.java:212)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_33]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_33]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_33]
Caused by: org.infinispan.CacheException: Remote (node0005/default) failed unexpectedly
at
org.infinispan.remoting.transport.AbstractTransport.parseResponseAndAddToResponseList(AbstractTransport.java:96)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:541)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.topology.ClusterTopologyManagerImpl$2.call(ClusterTopologyManagerImpl.java:549)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.topology.ClusterTopologyManagerImpl$2.call(ClusterTopologyManagerImpl.java:546)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [rt.jar:1.6.0_33]
at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_33]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_33]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_33]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_33]
at org.jboss.threads.JBossThread.run(JBossThread.java:122)
[jboss-threads-2.0.0.GA-redhat-2.jar:2.0.0.GA-redhat-2]
Caused by: java.lang.IllegalStateException: transport was closed
at org.jgroups.blocks.GroupRequest.transportClosed(GroupRequest.java:273)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at org.jgroups.blocks.RequestCorrelator.stop(RequestCorrelator.java:269)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at org.jgroups.blocks.MessageDispatcher.stop(MessageDispatcher.java:152)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at org.jgroups.blocks.MessageDispatcher.channelDisconnected(MessageDispatcher.java:455)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at org.jgroups.Channel.notifyChannelDisconnected(Channel.java:507)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at org.jgroups.JChannel.disconnect(JChannel.java:363)
[jgroups-3.2.6.Final-redhat-1.jar:3.2.6.Final-redhat-1]
at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.stop(JGroupsTransport.java:258)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.6.0_33]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[rt.jar:1.6.0_33]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[rt.jar:1.6.0_33]
at java.lang.reflect.Method.invoke(Method.java:597) [rt.jar:1.6.0_33]
at org.infinispan.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:203)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:883)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.factories.AbstractComponentRegistry.internalStop(AbstractComponentRegistry.java:690)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.factories.AbstractComponentRegistry.stop(AbstractComponentRegistry.java:568)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.factories.GlobalComponentRegistry.stop(GlobalComponentRegistry.java:260)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at org.infinispan.manager.DefaultCacheManager.stop(DefaultCacheManager.java:742)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.infinispan.manager.AbstractDelegatingEmbeddedCacheManager.stop(AbstractDelegatingEmbeddedCacheManager.java:179)
[infinispan-core-5.2.0.CR2-redhat-1.jar:5.2.0.CR2-redhat-1]
at
org.jboss.as.clustering.infinispan.subsystem.EmbeddedCacheManagerService.stop(EmbeddedCacheManagerService.java:76)
[jboss-datagrid-infinispan-6.1.0.ER9-redhat-1.jar:6.1.0.ER9-redhat-1]
at
org.jboss.msc.service.ServiceControllerImpl$StopTask.stopService(ServiceControllerImpl.java:1911)
[jboss-msc-1.0.2.GA-redhat-2.jar:1.0.2.GA-redhat-2]
at
org.jboss.msc.service.ServiceControllerImpl$StopTask.run(ServiceControllerImpl.java:1874)
[jboss-msc-1.0.2.GA-redhat-2.jar:1.0.2.GA-redhat-2]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_33]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_33]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_33]
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:
http://www.atlassian.com/software/jira