[
https://issues.jboss.org/browse/AS7-5442?page=com.atlassian.jira.plugin.s...
]
Radoslav Husar edited comment on AS7-5442 at 9/6/12 7:33 AM:
-------------------------------------------------------------
With upgrading to JGroups 3.0.14-SNAPHOST having JGRP-1508 fixed, we dont timeout anymore,
but new exception is thrown instantly:
{noformat}
[JBossINF] 06:25:23,765 WARN [org.infinispan.cacheviews.CacheViewsManagerImpl]
ISPN000169: Error committing cache view 5 for cache default-host/clusterbench:
org.infinispan.CacheException: java.lang.IllegalStateException: channel is not connected
[JBossINF] at org.infinispan.util.Util.rewrapAsCacheException(Util.java:526)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:139)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:492)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterCommitView(CacheViewsManagerImpl.java:378)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:272)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:894)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_30]
[JBossINF] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
[JBossINF] Caused by: java.lang.IllegalStateException: channel is not connected
[JBossINF] at
org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.down(MessageDispatcher.java:619)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.jgroups.blocks.RequestCorrelator.sendUnicastRequest(RequestCorrelator.java:193)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.UnicastRequest.sendRequest(UnicastRequest.java:44)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.Request.execute(Request.java:83)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.jgroups.blocks.MessageDispatcher.sendMessageWithFuture(MessageDispatcher.java:419)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processCalls(CommandAwareRpcDispatcher.java:329)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:132)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] ... 9 more
{noformat}
which is much better.
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-6x-failover-http-...
was (Author: rhusar):
With upgrading to JGroups 3.0.14-SNAPHOST having JGRP-1508 fixed, we dont timeout
anymore, but new exception is thrown instantly:
{noformat}
[JBossINF] 06:25:23,765 WARN [org.infinispan.cacheviews.CacheViewsManagerImpl]
ISPN000169: Error committing cache view 5 for cache default-host/clusterbench:
org.infinispan.CacheException: java.lang.IllegalStateException: channel is not connected
[JBossINF] at org.infinispan.util.Util.rewrapAsCacheException(Util.java:526)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:139)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:492)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterCommitView(CacheViewsManagerImpl.java:378)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:272)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:894)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_30]
[JBossINF] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
[JBossINF] Caused by: java.lang.IllegalStateException: channel is not connected
[JBossINF] at
org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.down(MessageDispatcher.java:619)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.jgroups.blocks.RequestCorrelator.sendUnicastRequest(RequestCorrelator.java:193)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.UnicastRequest.sendRequest(UnicastRequest.java:44)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at org.jgroups.blocks.Request.execute(Request.java:83)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.jgroups.blocks.MessageDispatcher.sendMessageWithFuture(MessageDispatcher.java:419)
[jgroups-3.0.14.Final.jar:3.0.14.Final]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processCalls(CommandAwareRpcDispatcher.java:329)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:132)
[infinispan-core-5.1.7-SNAPSHOT.jar:5.1.7-SNAPSHOT]
[JBossINF] ... 9 more
{noformat}
which is much better.
Graceful shutdown consistently results in "ISPN000172: Failed to
prepare view CacheView... java.util.concurrent.TimeoutException"
---------------------------------------------------------------------------------------------------------------------------------
Key: AS7-5442
URL:
https://issues.jboss.org/browse/AS7-5442
Project: Application Server 7
Issue Type: Bug
Components: Clustering
Reporter: Radoslav Husar
Assignee: Paul Ferraro
Priority: Blocker
Fix For: 7.1.3.Final (EAP)
Testing Dan's and Bela's fixes for AS7-5381 and including Paul's AS code
fixes, we are consistently seeing Timeout upon node shutdown.
{noformat}
[JBossINF] 14:22:21,362 ERROR [org.infinispan.cacheviews.CacheViewsManagerImpl]
ISPN000172: Failed to prepare view CacheView{viewId=5, members=[perf21/web, perf20/web,
perf19/web]} for cache default-host/clusterbench, rolling back to view
CacheView{viewId=4, members=[perf18/web, perf21/web, perf20/web, perf19/web]}:
java.util.concurrent.TimeoutException
[JBossINF] at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
[rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.FutureTask.get(FutureTask.java:91) [rt.jar:1.6.0_30]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterPrepareView(CacheViewsManagerImpl.java:319)
[infinispan-core.jar:5.1.6-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl.clusterInstallView(CacheViewsManagerImpl.java:250)
[infinispan-core.jar:5.1.6-SNAPSHOT]
[JBossINF] at
org.infinispan.cacheviews.CacheViewsManagerImpl$ViewInstallationTask.call(CacheViewsManagerImpl.java:890)
[infinispan-core.jar:5.1.6-SNAPSHOT]
[JBossINF] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[rt.jar:1.6.0_30]
[JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[rt.jar:1.6.0_30]
[JBossINF] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[rt.jar:1.6.0_30]
[JBossINF] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
{noformat}
The server is then shutting down for over a minute (when the TO is reached).
https://issues.jboss.org/browse/JBPAPP-9658?focusedCommentId=12712762&...
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failo...
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failo...
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failo...
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP6/view/EAP6-Failo...
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:
http://www.atlassian.com/software/jira