[jboss-jira] [JBoss JIRA] (AS7-3180) Clean shutdown often results in "Problems unmarshalling remote command from byte buffer"
Radoslav Husar (JIRA)
jira-events at lists.jboss.org
Tue Feb 7 11:06:49 EST 2012
[ https://issues.jboss.org/browse/AS7-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Radoslav Husar reassigned AS7-3180:
-----------------------------------
Assignee: Paul Ferraro (was: Radoslav Husar)
Still seeing it. Also noticed that there was problem with the deployment:
[JBossINF] 17:16:56,953 ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 1) JBAS015052: Did not receive a response to the deployment operation within the allowed timeout period [60 seconds]. Check the server configuration file and the server logs to find more about the status of the deployment.
Here is the whole log:
{noformat}
JAVA_OPTS already set in environment; overriding default settings with values: -Xmx5g -XX:+UseLargePages -Dsf.pid=NquV8n14Yh8NRgLj
=========================================================================
JBoss Bootstrap Environment
JBOSS_HOME: /tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT
JAVA: /qa/tools/opt/amd64/jdk1.6.0_last/bin/java
JAVA_OPTS: -server -XX:+UseCompressedOops -XX:+TieredCompilation -Xmx5g -XX:+UseLargePages -Dsf.pid=NquV8n14Yh8NRgLj
=========================================================================
17:15:55,101 INFO [org.jboss.modules] JBoss Modules version 1.1.0.GA
17:15:55,281 INFO [org.jboss.msc] JBoss MSC version 1.0.2.GA
17:15:55,335 INFO [org.jboss.as] JBAS015899: JBoss AS 7.1.0.Final-SNAPSHOT "Flux Capacitor" starting
17:15:56,338 WARN [org.jboss.as.server] JBAS015883: No security realm defined for native management service; all access will be unrestricted.
17:15:56,346 INFO [org.xnio] XNIO Version 3.0.0.GA
17:15:56,348 INFO [org.jboss.as.server] JBAS015888: Creating http management service using socket-binding (management-http)
17:15:56,349 WARN [org.jboss.as.server] JBAS015884: No security realm defined for http management service; all access will be unrestricted.
17:15:56,358 INFO [org.xnio.nio] XNIO NIO Implementation Version 3.0.0.GA
17:15:56,371 INFO [org.jboss.remoting] JBoss Remoting version 3.2.0.CR9
17:15:56,405 INFO [org.jboss.as.logging] JBAS011502: Removing bootstrap log handlers
17:15:56,408 INFO [org.jboss.as.configadmin] (ServerService Thread Pool -- 30) JBAS016200: Activating ConfigAdmin Subsystem
17:15:56,419 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 35) JBAS010280: Activating Infinispan subsystem.
17:15:56,424 INFO [org.jboss.as.jacorb] (ServerService Thread Pool -- 36) JBAS016300: Activating JacORB Subsystem
17:15:56,441 INFO [org.jboss.as.clustering.jgroups] (ServerService Thread Pool -- 40) JBAS010260: Activating JGroups subsystem.
17:15:56,451 INFO [org.jboss.as.osgi] (ServerService Thread Pool -- 47) JBAS011940: Activating OSGi Subsystem
17:15:56,456 INFO [org.jboss.as.security] (ServerService Thread Pool -- 52) JBAS013101: Activating Security Subsystem
17:15:56,459 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 46) JBAS011800: Activating Naming Subsystem
17:15:56,480 INFO [org.jboss.as.connector] (MSC service thread 1-14) JBAS010408: Starting JCA Subsystem (JBoss IronJacamar 1.0.7.Final)
17:15:56,484 INFO [org.jboss.as.security] (MSC service thread 1-15) JBAS013100: Current PicketBox version=4.0.6.final
17:15:56,489 INFO [org.jboss.as.webservices] (ServerService Thread Pool -- 56) JBAS015537: Activating WebServices Extension
17:15:56,547 INFO [org.jboss.as.naming] (MSC service thread 1-10) JBAS011802: Starting Naming Service
17:15:56,559 INFO [org.jboss.as.mail.extension] (MSC service thread 1-10) JBAS015400: Bound mail session [java:jboss/mail/Default]
17:15:56,599 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 31) JBAS010403: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
17:15:56,630 INFO [org.jboss.as.remoting] (MSC service thread 1-8) JBAS017100: Listening on perf18/10.16.90.54:9999
17:15:56,630 INFO [org.jboss.as.remoting] (MSC service thread 1-3) JBAS017100: Listening on perf18/10.16.90.54:4447
17:15:56,655 INFO [org.jboss.ws.common.management.AbstractServerConfig] (MSC service thread 1-1) JBoss Web Services - Stack CXF Server 4.0.1.GA
17:15:56,784 INFO [org.apache.coyote.ajp.AjpAprProtocol] (MSC service thread 1-12) Starting Coyote AJP/1.3 on ajp-perf18-10.16.90.54-8009
17:15:56,787 INFO [org.apache.coyote.http11.Http11AprProtocol] (MSC service thread 1-4) Starting Coyote HTTP/1.1 on http-perf18-10.16.90.54-8080
17:15:56,796 INFO [org.jboss.as.modcluster] (MSC service thread 1-9) JBAS011704: Mod_cluster uses default load balancer provider
17:15:56,832 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 35) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:56,838 INFO [org.jboss.as.jacorb] (MSC service thread 1-7) JBAS016330: CORBA ORB Service started
17:15:56,847 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 35) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:56,859 INFO [org.jboss.modcluster.ModClusterService] (MSC service thread 1-9) Initializing mod_cluster 1.2.0.Beta4
17:15:56,882 INFO [org.jboss.modcluster.advertise.impl.AdvertiseListenerImpl] (MSC service thread 1-9) Listening to proxy advertisements on 230.3.90.52:23364
17:15:56,944 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-10) JBAS015012: Started FileSystemDeploymentService for directory /tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT/standalone/deployments
17:15:56,954 INFO [org.jboss.as.jacorb] (MSC service thread 1-1) JBAS016328: CORBA Naming Service started
17:15:56,968 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-2) JBAS010400: Bound data source [java:jboss/datasources/ExampleDS]
17:15:56,988 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-4) live server is starting with configuration HornetQ Configuration (clustered=false,backup=false,sharedStore=true,journalDirectory=/tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT/standalone/data/messagingjournal,bindingsDirectory=/tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT/standalone/data/messagingbindings,largeMessagesDirectory=/tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT/standalone/data/messaginglargemessages,pagingDirectory=/tmp/hudson/jboss-as-7.1.0.Final-SNAPSHOT/standalone/data/messagingpaging)
17:15:56,999 WARNING [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-4) Security risk! It has been detected that the cluster admin user and password have not been changed from the installation default. Please see the HornetQ user guide, cluster chapter, for instructions on how to do this.
17:15:57,106 INFO [org.hornetq.core.remoting.impl.netty.NettyAcceptor] (MSC service thread 1-4) Started Netty Acceptor version 3.2.5.Final-a96d88c perf18:5445 for CORE protocol
17:15:57,108 INFO [org.hornetq.core.remoting.impl.netty.NettyAcceptor] (MSC service thread 1-4) Started Netty Acceptor version 3.2.5.Final-a96d88c perf18:5455 for CORE protocol
17:15:57,110 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-4) Server is now live
17:15:57,110 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-4) HornetQ Server version 2.2.11.Final (HQ_2_2_11_FINAL_AS7, 122) [ac0d7d81-510f-11e1-80bf-d48564693bb6]) started
17:15:57,114 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-2) trying to deploy queue jms.queue.testQueue
17:15:57,173 INFO [org.jboss.as.messaging] (MSC service thread 1-2) JBAS011601: Bound messaging object to jndi name java:/queue/test
17:15:57,174 INFO [org.hornetq.core.server.impl.HornetQServerImpl] (MSC service thread 1-9) trying to deploy queue jms.topic.testTopic
17:15:57,190 INFO [org.jboss.as.messaging] (MSC service thread 1-9) JBAS011601: Bound messaging object to jndi name java:/topic/test
17:15:57,190 INFO [org.jboss.as.deployment.connector] (MSC service thread 1-4) JBAS010406: Registered connection factory java:/JmsXA
17:15:57,194 INFO [org.jboss.as.messaging] (MSC service thread 1-16) JBAS011601: Bound messaging object to jndi name java:/ConnectionFactory
17:15:57,195 INFO [org.jboss.as.messaging] (MSC service thread 1-14) JBAS011601: Bound messaging object to jndi name java:/RemoteConnectionFactory
17:15:57,200 INFO [org.hornetq.ra.HornetQResourceAdapter] (MSC service thread 1-4) HornetQ resource adaptor started
17:15:57,200 INFO [org.jboss.as.connector.services.ResourceAdapterActivatorService$ResourceAdapterActivator] (MSC service thread 1-4) IJ020002: Deployed: file://RaActivatorhornetq-ra
17:15:57,202 INFO [org.jboss.as.deployment.connector] (MSC service thread 1-12) JBAS010401: Bound JCA ConnectionFactory [java:/JmsXA]
17:15:57,222 INFO [org.jboss.as] (Controller Boot Thread) JBAS015874: JBoss AS 7.1.0.Final-SNAPSHOT "Flux Capacitor" started in 2377ms - Started 161 of 283 services (121 services are passive or on-demand)
2012/02/06 17:15:57:222 EST [DEBUG][Thread-32] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - JBossStartup, server started!
17:15:57,231 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) JBAS015876: Starting deployment of "clusterbench-ee6.ear"
17:15:57,291 INFO [org.jboss.as.server.deployment] (MSC service thread 1-4) JBAS015876: Starting deployment of "clusterbench-ee6-ejb.jar"
17:15:57,291 INFO [org.jboss.as.server.deployment] (MSC service thread 1-14) JBAS015876: Starting deployment of "clusterbench-ee6-web.war"
17:15:57,394 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) JBAS016002: Processing weld deployment clusterbench-ee6.ear
17:15:57,443 INFO [org.jboss.weld.deployer] (MSC service thread 1-8) JBAS016002: Processing weld deployment clusterbench-ee6-web.war
17:15:57,443 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) JBAS016002: Processing weld deployment clusterbench-ee6-ejb.jar
17:15:57,447 INFO [org.jboss.as.ejb3.deployment.processors.EjbJndiBindingsDeploymentUnitProcessor] (MSC service thread 1-4) JNDI bindings for session bean named RemoteSingletonSBImpl in deployment unit subdeployment "clusterbench-ee6-ejb.jar" of deployment "clusterbench-ee6.ear" are as follows:
java:global/clusterbench-ee6/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSBImpl
java:app/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSBImpl
java:module/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSBImpl
java:jboss/exported/clusterbench-ee6/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSBImpl
java:global/clusterbench-ee6/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSB
java:app/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSB
java:module/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSB
java:jboss/exported/clusterbench-ee6/clusterbench-ee6-ejb/RemoteSingletonSBImpl!org.jboss.test.clusterbench.ejb.singleton.RemoteSingletonSB
17:15:57,450 INFO [org.jboss.as.ejb3.deployment.processors.EjbJndiBindingsDeploymentUnitProcessor] (MSC service thread 1-4) JNDI bindings for session bean named RemoteStatefulSBImpl in deployment unit subdeployment "clusterbench-ee6-ejb.jar" of deployment "clusterbench-ee6.ear" are as follows:
java:global/clusterbench-ee6/clusterbench-ee6-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
java:app/clusterbench-ee6-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
java:module/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
java:jboss/exported/clusterbench-ee6/clusterbench-ee6-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
java:global/clusterbench-ee6/clusterbench-ee6-ejb/RemoteStatefulSBImpl
java:app/clusterbench-ee6-ejb/RemoteStatefulSBImpl
java:module/RemoteStatefulSBImpl
17:15:57,452 INFO [org.jboss.as.ejb3.deployment.processors.EjbJndiBindingsDeploymentUnitProcessor] (MSC service thread 1-4) JNDI bindings for session bean named LocalStatefulSB in deployment unit subdeployment "clusterbench-ee6-ejb.jar" of deployment "clusterbench-ee6.ear" are as follows:
java:global/clusterbench-ee6/clusterbench-ee6-ejb/LocalStatefulSB!org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB
java:app/clusterbench-ee6-ejb/LocalStatefulSB!org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB
java:module/LocalStatefulSB!org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB
java:jboss/exported/clusterbench-ee6/clusterbench-ee6-ejb/LocalStatefulSB!org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB
java:global/clusterbench-ee6/clusterbench-ee6-ejb/LocalStatefulSB
java:app/clusterbench-ee6-ejb/LocalStatefulSB
java:module/LocalStatefulSB
17:15:57,454 INFO [org.jboss.as.ejb3.deployment.processors.EjbJndiBindingsDeploymentUnitProcessor] (MSC service thread 1-4) JNDI bindings for session bean named LocalSingletonSB in deployment unit subdeployment "clusterbench-ee6-ejb.jar" of deployment "clusterbench-ee6.ear" are as follows:
java:global/clusterbench-ee6/clusterbench-ee6-ejb/LocalSingletonSB!org.jboss.test.clusterbench.ejb.singleton.LocalSingletonSB
java:app/clusterbench-ee6-ejb/LocalSingletonSB!org.jboss.test.clusterbench.ejb.singleton.LocalSingletonSB
java:module/LocalSingletonSB!org.jboss.test.clusterbench.ejb.singleton.LocalSingletonSB
java:jboss/exported/clusterbench-ee6/clusterbench-ee6-ejb/LocalSingletonSB!org.jboss.test.clusterbench.ejb.singleton.LocalSingletonSB
java:global/clusterbench-ee6/clusterbench-ee6-ejb/LocalSingletonSB
java:app/clusterbench-ee6-ejb/LocalSingletonSB
java:module/LocalSingletonSB
17:15:57,477 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) JBAS016005: Starting Services for CDI deployment: clusterbench-ee6.ear
17:15:57,534 INFO [org.jboss.weld.Version] (MSC service thread 1-4) WELD-000900 1.1.5 (Final)
17:15:57,550 INFO [org.jboss.weld.deployer] (MSC service thread 1-10) JBAS016008: Starting weld service for deployment clusterbench-ee6.ear
17:15:57,855 INFO [stdout] (pool-14-thread-1)
17:15:57,855 INFO [stdout] (pool-14-thread-1) -------------------------------------------------------------------
17:15:57,855 INFO [stdout] (pool-14-thread-1) GMS: address=perf18/web, cluster=web, physical address=10.16.90.54:55200
17:15:57,856 INFO [stdout] (pool-14-thread-1) -------------------------------------------------------------------
17:15:57,860 INFO [stdout] (pool-19-thread-1)
17:15:57,860 INFO [stdout] (pool-19-thread-1) -------------------------------------------------------------------
17:15:57,861 INFO [stdout] (pool-19-thread-1) GMS: address=perf18/ejb, cluster=ejb, physical address=10.16.90.54:55200
17:15:57,861 INFO [stdout] (pool-19-thread-1) -------------------------------------------------------------------
17:15:57,955 INFO [org.jboss.as.clustering.impl.CoreGroupCommunicationService.ejb] (MSC service thread 1-11) JBAS010206: Number of cluster members: 4
17:15:57,955 INFO [org.jboss.as.clustering.impl.CoreGroupCommunicationService.web] (MSC service thread 1-6) JBAS010206: Number of cluster members: 4
17:15:58,149 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-7) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:58,151 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-2) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:58,167 INFO [org.infinispan.config.ConfigurationValidatingVisitor] (pool-15-thread-1) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:58,293 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-15-thread-1) ISPN000078: Starting JGroups Channel
17:15:58,293 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-21-thread-1) ISPN000078: Starting JGroups Channel
17:15:58,295 WARNING [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (pool-21-thread-1) Channel Muxer already has a default up handler installed (org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler at 65919e73) but now it is being overridden
17:15:58,295 WARNING [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (pool-15-thread-1) Channel Muxer already has a default up handler installed (org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler at 3b39c41d) but now it is being overridden
17:15:58,296 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-21-thread-1) ISPN000094: Received new cluster view: [perf21/ejb|5] [perf21/ejb, perf20/ejb, perf19/ejb, perf18/ejb]
17:15:58,296 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-15-thread-1) ISPN000094: Received new cluster view: [perf21/web|5] [perf21/web, perf20/web, perf19/web, perf18/web]
17:15:58,298 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-21-thread-1) ISPN000079: Cache local address is perf18/ejb, physical addresses are [10.16.90.54:55200]
17:15:58,298 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-15-thread-1) ISPN000079: Cache local address is perf18/web, physical addresses are [10.16.90.54:55200]
17:15:58,302 INFO [org.infinispan.factories.GlobalComponentRegistry] (pool-21-thread-1) ISPN000128: Infinispan version: Infinispan 'Brahma' 5.1.1.FINAL
17:15:58,302 INFO [org.infinispan.factories.GlobalComponentRegistry] (pool-15-thread-1) ISPN000128: Infinispan version: Infinispan 'Brahma' 5.1.1.FINAL
17:15:58,322 INFO [org.infinispan.jmx.CacheJmxRegistration] (pool-21-thread-1) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,334 INFO [org.infinispan.jmx.CacheJmxRegistration] (pool-15-thread-1) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,334 INFO [org.infinispan.jmx.CacheJmxRegistration] (pool-20-thread-1) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,378 INFO [org.jboss.as.clustering.infinispan] (pool-20-thread-1) JBAS010281: Started repl cache from ejb container
17:15:58,381 INFO [org.jboss.as.clustering.infinispan] (pool-21-thread-1) JBAS010281: Started remote-connector-client-mappings cache from ejb container
17:15:58,382 INFO [org.jboss.as.clustering.infinispan] (pool-15-thread-1) JBAS010281: Started repl cache from web container
17:15:58,425 INFO [org.jboss.ejb.client.ClusterContext] (ejb-client-cluster-node-connection-creation-1-thread-1) Added a new EJB receiver in cluster context ejb for node perf18. Total nodes in cluster context = 1
17:15:58,427 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-14) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:58,429 INFO [org.infinispan.config.ConfigurationValidatingVisitor] (MSC service thread 1-14) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:15:58,435 INFO [org.infinispan.jmx.CacheJmxRegistration] (MSC service thread 1-14) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,448 INFO [org.infinispan.jmx.CacheJmxRegistration] (MSC service thread 1-4) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,450 INFO [org.infinispan.jmx.CacheJmxRegistration] (MSC service thread 1-16) ISPN000031: MBeans were successfully registered to the platform mbean server.
17:15:58,457 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) JBAS010281: Started org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSBImpl cache from ejb container
17:15:58,468 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-16) JBAS010281: Started org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB cache from ejb container
2012/02/06 17:16:54:542 EST [DEBUG][Thread-34] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - JBossStartup, server started!
17:16:56,953 INFO [org.jboss.as.server] (DeploymentScanner-threads - 2) JBAS015870: Deploy of deployment "clusterbench-ee6.ear" was rolled back with failure message Operation cancelled
17:16:56,953 ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 1) JBAS015052: Did not receive a response to the deployment operation within the allowed timeout period [60 seconds]. Check the server configuration file and the server logs to find more about the status of the deployment.
17:16:56,960 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-5) ISPN000029: Passivating all entries to disk
17:16:56,960 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-13) ISPN000029: Passivating all entries to disk
17:16:56,962 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-13) ISPN000030: Passivated 0 entries in 2 milliseconds
17:16:56,962 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-5) ISPN000030: Passivated 0 entries in 2 milliseconds
17:16:56,969 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-5) JBAS010282: Stopped org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB cache from ejb container
17:16:56,972 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-13) JBAS010282: Stopped org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSBImpl cache from ejb container
17:16:57,852 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-14) JBAS010281: Started //default-host//clusterbench cache from web container
17:16:57,874 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-14) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:16:57,875 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-14) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be pasivated.
17:16:58,050 INFO [javax.enterprise.resource.webcontainer.jsf.config] (MSC service thread 1-14) Initializing Mojarra 2.1.5 (SNAPSHOT 20111202) for context '/clusterbench'
17:16:58,664 INFO [org.hibernate.validator.util.Version] (MSC service thread 1-14) Hibernate Validator 4.2.0.Final
17:16:58,805 INFO [org.jboss.web] (MSC service thread 1-14) JBAS018210: Registering web context: /clusterbench
17:16:58,835 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-2) ISPN000029: Passivating all entries to disk
17:16:58,836 INFO [org.infinispan.eviction.PassivationManagerImpl] (MSC service thread 1-2) ISPN000030: Passivated 0 entries in 0 milliseconds
17:16:58,839 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) JBAS010282: Stopped //default-host//clusterbench cache from web container
17:16:58,845 INFO [org.jboss.weld.deployer] (MSC service thread 1-10) JBAS016009: Stopping weld service for deployment clusterbench-ee6.ear
17:16:58,853 INFO [org.infinispan.eviction.PassivationManagerImpl] (pool-20-thread-2) ISPN000029: Passivating all entries to disk
17:16:58,853 INFO [org.infinispan.eviction.PassivationManagerImpl] (pool-20-thread-2) ISPN000030: Passivated 0 entries in 0 milliseconds
17:16:58,856 INFO [org.jboss.as.clustering.infinispan] (pool-20-thread-2) JBAS010282: Stopped repl cache from ejb container
17:16:59,292 INFO [org.infinispan.eviction.PassivationManagerImpl] (pool-15-thread-2) ISPN000029: Passivating all entries to disk
17:16:59,293 INFO [org.infinispan.eviction.PassivationManagerImpl] (pool-15-thread-2) ISPN000030: Passivated 3 entries in 1 milliseconds
17:16:59,296 INFO [org.jboss.as.clustering.infinispan] (pool-15-thread-2) JBAS010282: Stopped repl cache from web container
17:16:59,297 INFO [org.jboss.as.server.deployment] (MSC service thread 1-4) JBAS015877: Stopped deployment clusterbench-ee6-ejb.jar in 2343ms
17:16:59,299 INFO [org.jboss.as.server.deployment] (MSC service thread 1-12) JBAS015877: Stopped deployment clusterbench-ee6-web.war in 2344ms
17:16:59,301 INFO [org.jboss.as.server.deployment] (MSC service thread 1-3) JBAS015877: Stopped deployment clusterbench-ee6.ear in 2348ms
17:16:59,316 INFO [org.jboss.as.clustering.infinispan] (pool-21-thread-2) JBAS010282: Stopped remote-connector-client-mappings cache from ejb container
17:16:59,378 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-13-thread-2) ISPN000082: Stopping the RpcDispatcher
17:16:59,382 WARN [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (Incoming-12,null) Problems unmarshalling remote command from byte buffer: org.infinispan.CacheException: Cache manager is either starting up or shutting down but it's not interrupted, so type (id=39) cannot be resolved.
at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:272) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.7.GA.jar:1.3.7.GA]
at org.infinispan.transaction.xa.GlobalTransaction$AbstractGlobalTxExternalizer.readObject(GlobalTransaction.java:150) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.transaction.xa.GlobalTransaction$Externalizer.readObject(GlobalTransaction.java:155) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.transaction.xa.GlobalTransaction$AbstractGlobalTxExternalizer.readObject(GlobalTransaction.java:133) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.readObject(ExternalizerTable.java:399) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:287) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.7.GA.jar:1.3.7.GA]
at org.infinispan.marshall.exts.ReplicableCommandExternalizer.readParameters(ReplicableCommandExternalizer.java:118) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.readObject(CacheRpcCommandExternalizer.java:164) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.readObject(CacheRpcCommandExternalizer.java:68) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.readObject(ExternalizerTable.java:399) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:287) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.7.GA.jar:1.3.7.GA]
at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectFromObjectStream(AbstractJBossMarshaller.java:148) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.VersionAwareMarshaller.objectFromByteBuffer(VersionAwareMarshaller.java:110) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.AbstractDelegatingMarshaller.objectFromByteBuffer(AbstractDelegatingMarshaller.java:84) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectFromBuffer(MarshallerAdapter.java:50) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:140) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:447) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:230) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:543) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler.up(ClassLoaderAwareUpHandler.java:56) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.MuxChannel$ClassLoaderAwareMuxUpHandler.up(MuxChannel.java:64) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.JChannel.up(JChannel.java:716) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1026) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FRAG2.up(FRAG2.java:181) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:400) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:418) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.GMS.up(GMS.java:881) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:383) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:730) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:559) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.BARRIER.up(BARRIER.java:126) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:140) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD.up(FD.java:273) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:282) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.MERGE2.up(MERGE2.java:205) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.Discovery.up(Discovery.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.Protocol.up(Protocol.java:358) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP.passMessageUp(TP.java:1174) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1709) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1691) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_30]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_30]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
17:16:59,444 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-18-thread-2) ISPN000082: Stopping the RpcDispatcher
17:16:59,480 WARN [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (Incoming-17,null) Problems unmarshalling remote command from byte buffer: org.infinispan.CacheException: Cache manager is either starting up or shutting down but it's not interrupted, so type (id=74) cannot be resolved.
at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:272) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.7.GA.jar:1.3.7.GA]
at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectFromObjectStream(AbstractJBossMarshaller.java:148) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.VersionAwareMarshaller.objectFromByteBuffer(VersionAwareMarshaller.java:110) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.AbstractDelegatingMarshaller.objectFromByteBuffer(AbstractDelegatingMarshaller.java:84) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectFromBuffer(MarshallerAdapter.java:50) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:140) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:447) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:230) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:543) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler.up(ClassLoaderAwareUpHandler.java:56) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.MuxChannel$ClassLoaderAwareMuxUpHandler.up(MuxChannel.java:64) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.JChannel.up(JChannel.java:716) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1026) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FRAG2.up(FRAG2.java:181) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:400) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:418) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.GMS.up(GMS.java:881) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:383) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:730) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:559) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.BARRIER.up(BARRIER.java:126) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:140) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD.up(FD.java:273) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:282) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.MERGE2.up(MERGE2.java:205) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.Discovery.up(Discovery.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.Protocol.up(Protocol.java:358) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP.passMessageUp(TP.java:1174) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1709) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1691) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_30]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_30]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
17:16:59,492 WARN [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (Incoming-17,null) Problems unmarshalling remote command from byte buffer: org.infinispan.CacheException: Cache manager is either starting up or shutting down but it's not interrupted, so type (id=74) cannot be resolved.
at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:272) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.7.GA.jar:1.3.7.GA]
at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectFromObjectStream(AbstractJBossMarshaller.java:148) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.VersionAwareMarshaller.objectFromByteBuffer(VersionAwareMarshaller.java:110) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.marshall.AbstractDelegatingMarshaller.objectFromByteBuffer(AbstractDelegatingMarshaller.java:84) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectFromBuffer(MarshallerAdapter.java:50) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:140) [infinispan-core-5.1.1.FINAL.jar:5.1.1.FINAL]
at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:447) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:230) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:543) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler.up(ClassLoaderAwareUpHandler.java:56) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jboss.as.clustering.jgroups.MuxChannel$ClassLoaderAwareMuxUpHandler.up(MuxChannel.java:64) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
at org.jgroups.JChannel.up(JChannel.java:716) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1026) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FRAG2.up(FRAG2.java:181) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:400) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FlowControl.up(FlowControl.java:418) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.GMS.up(GMS.java:881) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:383) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:730) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:559) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.BARRIER.up(BARRIER.java:126) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:140) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD.up(FD.java:273) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:282) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.MERGE2.up(MERGE2.java:205) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.Discovery.up(Discovery.java:354) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.stack.Protocol.up(Protocol.java:358) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP.passMessageUp(TP.java:1174) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1709) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1691) [jgroups-3.0.4.Final.jar:3.0.4.Final]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_30]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_30]
at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30]
2012/02/06 17:23:28:621 EST [DEBUG][RMI TCP Connection(17)-10.16.90.52] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - JBossApplicationServerImpl: sfTerminateWith().
2012/02/06 17:23:28:623 EST [DEBUG][RMI TCP Connection(17)-10.16.90.52] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - [JBossRuntime] sfTerminateWith() invoked.
2012/02/06 17:23:28:624 EST [DEBUG][Thread-35] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - JBossShutdown server host: perf18
2012/02/06 17:23:28:779 EST [DEBUG][RMI TCP Connection(17)-10.16.90.52] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - JBossShutdown command executed successfuly.
2012/02/06 17:23:28:779 EST [DEBUG][RMI TCP Connection(17)-10.16.90.52] HOST perf17.mw.lab.eng.bos.redhat.com:rootProcess:c - Waiting for server to shutdown.
17:23:28,790 INFO [org.jboss.as.logging] JBAS011503: Restored bootstrap log handlers
17:23:28,791 INFO [org.jboss.as.messaging] JBAS011605: Unbound messaging object to jndi name java:/ConnectionFactory
17:23:28,791 INFO [org.apache.coyote.ajp.AjpAprProtocol] Pausing Coyote AJP/1.3 on ajp-perf18-10.16.90.54-8009
17:23:28,792 INFO [org.apache.coyote.ajp.AjpAprProtocol] Stopping Coyote AJP/1.3 on ajp-perf18-10.16.90.54-8009
17:23:28,794 INFO [org.jboss.as.deployment.connector] JBAS010410: Unbound JCA ConnectionFactory [java:/JmsXA]
17:23:28,798 INFO [jacorb.poa] POA IRPOA destroyed
17:23:28,813 INFO [jacorb.poa] POA Naming destroyed
17:23:28,813 INFO [jacorb.poa] POA RootPOA destroyed
17:23:28,817 INFO [jacorb.orb] prepare ORB for shutdown...
17:23:28,817 INFO [jacorb.orb] ORB going down...
17:23:28,822 INFO [jacorb.orb] ORB shutdown complete
17:23:28,822 INFO [jacorb.orb.iiop] Listener exited
17:23:28,822 INFO [jacorb.orb] ORB run, exit
17:23:28,883 INFO [org.hornetq.ra.HornetQResourceAdapter] HornetQ resource adapter stopped
17:23:28,970 INFO [org.hornetq.core.server.impl.HornetQServerImpl] HornetQ Server version 2.2.11.Final (HQ_2_2_11_FINAL_AS7, 122) [ac0d7d81-510f-11e1-80bf-d48564693bb6] stopped
17:23:28,972 INFO [com.arjuna.ats.jbossatx] ARJUNA032018: Destroying TransactionManagerService
17:23:28,972 INFO [com.arjuna.ats.jbossatx] ARJUNA032014: Stopping transaction recovery manager
17:23:28,981 INFO [org.jboss.as] JBAS015950: JBoss AS 7.1.0.Final-SNAPSHOT "Flux Capacitor" stopped in 191ms
{noformat}
> Clean shutdown often results in "Problems unmarshalling remote command from byte buffer"
> ----------------------------------------------------------------------------------------
>
> Key: AS7-3180
> URL: https://issues.jboss.org/browse/AS7-3180
> Project: Application Server 7
> Issue Type: Bug
> Components: Clustering
> Affects Versions: 7.1.0.CR1
> Reporter: Radoslav Husar
> Assignee: Paul Ferraro
> Labels: eap6_prd_req, failover_testing
> Fix For: 7.1.0.Final
>
>
> When shutting down a server from a cluster, it often results in
> WARN [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Problems unmarshalling remote command from byte buffer: org.infinispan.CacheException: Cache manager is either starting up or shutting down but it's not interrupted, so type (id=74) cannot be resolved.
> incluing verbose logging which doesnt seem necessary
> and jgroups logs
> [JBossINF] 12:28:22,392 SEVERE [org.jgroups.protocols.UNICAST2] perf19/web: sender window for perf21/web not found
> is this a real problem? if not, can it be handled more cleanly?
> {noformat}
> [JBossINF] 12:28:21,960 INFO [org.apache.coyote.http11.Http11AprProtocol] (MSC service thread 1-7) Pausing Coyote HTTP/1.1 on http-perf19-10.16.90.56-8080
> [JBossINF] 12:28:21,961 INFO [org.apache.coyote.http11.Http11AprProtocol] (MSC service thread 1-7) Stopping Coyote HTTP/1.1 on http-perf19-10.16.90.56-8080
> [JBossINF] 12:28:21,974 INFO [org.jboss.as.logging] JBAS011503: Restored bootstrap log handlers
> [JBossINF] 12:28:21,975 INFO [org.apache.catalina.core.StandardContext] Container org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/] has not been started
> [JBossINF] 12:28:22,008 INFO [org.jboss.as.clustering] JBAS010302: Stopped org.jboss.test.clusterbench.ejb.stateful.LocalStatefulSB cache from sfsb container
> [JBossINF] 12:28:22,010 INFO [org.hornetq.core.server.impl.HornetQServerImpl] HornetQ Server version 2.2.7.Final (HQ_2_2_7_FINAL_AS7, 121) [be9627f1-362f-11e1-986b-d4856468f854] stopped
> [JBossINF] 12:28:22,012 INFO [org.apache.coyote.ajp.AjpAprProtocol] Pausing Coyote AJP/1.3 on ajp-perf19-10.16.90.56-8009
> [JBossINF] 12:28:22,012 INFO [org.apache.coyote.ajp.AjpAprProtocol] Stopping Coyote AJP/1.3 on ajp-perf19-10.16.90.56-8009
> [JBossINF] 12:28:22,013 INFO [org.jboss.as.clustering] JBAS010302: Stopped org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSBImpl cache from sfsb container
> [JBossINF] 12:28:22,022 INFO [jacorb.poa] POA RootPOA destroyed
> [JBossINF] 12:28:22,029 INFO [org.infinispan.eviction.PassivationManagerImpl] ISPN000029: Passivating all entries to disk
> [JBossINF] 12:28:22,029 INFO [org.infinispan.eviction.PassivationManagerImpl] ISPN000030: Passivated 0 entries in 0 milliseconds
> [JBossINF] 12:28:22,030 INFO [jacorb.orb] prepare ORB for shutdown...
> [JBossINF] 12:28:22,030 INFO [jacorb.orb] ORB going down...
> [JBossINF] 12:28:22,031 INFO [jacorb.orb] ORB shutdown complete
> [JBossINF] 12:28:22,032 INFO [jacorb.orb] ORB run, exit
> [JBossINF] 12:28:22,032 INFO [jacorb.orb.iiop] Listener exited
> [JBossINF] 12:28:22,036 INFO [org.jboss.weld] Stopping weld service
> [JBossINF] 12:28:22,038 INFO [org.infinispan.eviction.PassivationManagerImpl] ISPN000029: Passivating all entries to disk
> [JBossINF] 12:28:22,038 INFO [org.infinispan.eviction.PassivationManagerImpl] ISPN000030: Passivated 0 entries in 0 milliseconds
> [JBossINF] 12:28:22,047 INFO [org.jboss.as.server.deployment] Stopped deployment clusterbench-ee6-ejb.jar in 91ms
> [JBossINF] 12:28:22,048 INFO [org.jboss.as.server.deployment] Stopped deployment clusterbench-ee6-web.war in 91ms
> [JBossINF] 12:28:22,049 INFO [org.jboss.as.server.deployment] Stopped deployment clusterbench-ee6.ear in 97ms
> [JBossINF] 12:28:22,057 INFO [org.jboss.as.clustering] JBAS010302: Stopped registry cache from web container
> [JBossINF] 12:28:22,063 INFO [org.jboss.as.clustering] JBAS010302: Stopped repl cache from web container
> [JBossINF] 12:28:22,069 INFO [org.jboss.as.clustering] JBAS010302: Stopped repl cache from sfsb container
> [JBossINF] 12:28:22,336 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher
> [JBossINF] 12:28:22,392 SEVERE [org.jgroups.protocols.UNICAST2] perf19/web: sender window for perf21/web not found
> [JBossINF] 12:28:22,440 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher
> [JBossINF] 12:28:22,441 INFO [com.arjuna.ats.jbossatx] ARJUNA032018: Destroying TransactionManagerService
> [JBossINF] 12:28:22,442 INFO [com.arjuna.ats.jbossatx] ARJUNA032014: Stopping transaction recovery manager
> [JBossINF] 12:28:22,463 WARN [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Problems unmarshalling remote command from byte buffer: org.infinispan.CacheException: Cache manager is either starting up or shutting down but it's not interrupted, so type (id=74) cannot be resolved.
> [JBossINF] at org.infinispan.marshall.jboss.ExternalizerTable.readObject(ExternalizerTable.java:257) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:351)
> [JBossINF] at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:209)
> [JBossINF] at org.jboss.marshalling.AbstractObjectInput.readObject(AbstractObjectInput.java:37) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA]
> [JBossINF] at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectFromObjectStream(AbstractJBossMarshaller.java:120) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.infinispan.marshall.VersionAwareMarshaller.objectFromByteBuffer(VersionAwareMarshaller.java:115) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.infinispan.marshall.AbstractDelegatingMarshaller.objectFromByteBuffer(AbstractDelegatingMarshaller.java:79) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectFromBuffer(MarshallerAdapter.java:50) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:139) [infinispan-core-5.1.0.CR1.jar:5.1.0.CR1]
> [JBossINF] at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:447) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:354) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:230) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:556) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jboss.as.clustering.jgroups.ClassLoaderAwareUpHandler.up(ClassLoaderAwareUpHandler.java:56) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
> [JBossINF] at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jboss.as.clustering.jgroups.MuxChannel$ClassLoaderAwareMuxUpHandler.up(MuxChannel.java:64) [jboss-as-clustering-jgroups-7.1.0.Final-SNAPSHOT.jar:7.1.0.Final-SNAPSHOT]
> [JBossINF] at org.jgroups.JChannel.up(JChannel.java:716) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1026) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:481) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.STATE_TRANSFER.up(STATE_TRANSFER.java:178) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.FRAG2.up(FRAG2.java:181) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.FlowControl.up(FlowControl.java:400) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.FlowControl.up(FlowControl.java:418) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.GMS.up(GMS.java:881) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:383) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:733) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:561) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.BARRIER.up(BARRIER.java:126) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:140) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.FD.up(FD.java:273) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:284) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.MERGE2.up(MERGE2.java:205) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.Discovery.up(Discovery.java:354) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.stack.Protocol.up(Protocol.java:358) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.TP.passMessageUp(TP.java:1174) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1709) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1691) [jgroups-3.0.1.Final.jar:3.0.1.Final]
> [JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_29]
> [JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_29]
> [JBossINF] at java.lang.Thread.run(Thread.java:662) [:1.6.0_29]
> [JBossINF]
> [JBossINF] 12:28:22,809 INFO [org.jboss.as] JBoss AS 7.1.0.Final-SNAPSHOT "Flux Capacitor" stopped in 815ms
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
More information about the jboss-jira
mailing list