[jboss-jira] [JBoss JIRA] (AS7-5442) Graceful shutdown consistently results in "ISPN000172: Failed to prepare view CacheView... java.util.concurrent.TimeoutException"
Radoslav Husar (JIRA)
jira-events at lists.jboss.org
Thu Sep 6 06:32:32 EDT 2012
[ https://issues.jboss.org/browse/AS7-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716286#comment-12716286 ]
Radoslav Husar commented on AS7-5442:
-------------------------------------
With upgrading to JGroups 3.0.14-SNAPHOST having JGRP-1508 fixed, we dont timeout anymore, but new exception is thrown instantly:
{noformat}
[JBossINF] 06:25:23,765 WARN [org.infinispan.cacheviews.CacheViewsManagerImpl] ISPN000169: Error committing cache view 5 for cache default-host/clusterbench: org.infinispan.CacheException: java.lang.IllegalStateException: channel is not connected
[JBossINF] at org.infinispan.util.Util.rewrapAsCacheException(Util.java:526) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:139) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:492) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterCommitView(CacheViewsManagerImpl.java:378) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:272) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:894) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_30]
[JBossINF] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
[JBossINF] Caused by: java.lang.IllegalStateException: channel is not connected
[JBossINF] at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.down(MessageDispatcher.java:619) [jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.RequestCorrelator.sendUnicastRequest(RequestCorrelator.java:193) [jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.UnicastRequest.sendRequest(UnicastRequest.java:44) [jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.Request.execute(Request.java:83) [jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.MessageDispatcher.sendMessageWithFuture(MessageDispatcher.java:419) [jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processCalls(CommandAwareRpcDispatcher.java:329) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:132) [infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] ... 9 more
{noformat}
which is much better.
> Graceful shutdown consistently results in "ISPN000172: Failed to prepare view CacheView... java.util.concurrent.TimeoutException"
> ---------------------------------------------------------------------------------------------------------------------------------
>
> Key: AS7-5442
> URL: https://issues.jboss.org/browse/AS7-5442
> Project: Application Server 7
> Issue Type: Bug
> Components: Clustering
> Reporter: Radoslav Husar
> Assignee: Paul Ferraro
> Priority: Blocker
> Fix For: 7.1.3.Final (EAP)
>
>
> Testing Dan's and Bela's fixes for AS7-5381 and including Paul's AS code fixes, we are consistently seeing Timeout upon node shutdown.
> {noformat}
> [JBossINF] 14:22:21,362 ERROR [org.infinispan.cacheviews.CacheViewsManagerImpl] ISPN000172: Failed to prepare view CacheView{viewId=5, members=[perf21/web, perf20/web, perf19/web]} for cache default-host/clusterbench, rolling back to view CacheView{viewId=4, members=[perf18/web, perf21/web, perf20/web, perf19/web]}: java.util.concurrent.TimeoutException
> [JBossINF] at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228) [rt.jar:1.6.0_30]
> [JBossINF] at java.util.concurrent.FutureTask.get(FutureTask.java:91) [rt.jar:1.6.0_30]
> [JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterPrepareView(CacheViewsManagerImpl.java:319) [infinispan-core.jar:5.1.6-SNAPSHOT]
> [JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:250) [infinispan-core.jar:5.1.6-SNAPSHOT]
> [JBossINF] at org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:890) [infinispan-core.jar:5.1.6-SNAPSHOT]
> [JBossINF] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [rt.jar:1.6.0_30]
> [JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_30]
> [JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_30]
> [JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_30]
> [JBossINF] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
> {noformat}
> The server is then shutting down for over a minute (when the TO is reached).
> https://issues.jboss.org/browse/JBPAPP-9658?focusedCommentId=12712762&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12712762
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failover/job/eap-6x-failover-http-session-shutdown-dist-async/27/
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failover/job/eap-6x-failover-http-session-shutdown-dist-sync/27/
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failover/job/eap-6x-failover-http-session-shutdown-repl-async/29/
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failover/job/eap-6x-failover-http-session-shutdown-repl-sync/50/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
More information about the jboss-jira
mailing list