As seen from the server log the server process is not destroyed after 45 secs in this case. This is something to look at in the jboss-test project. The delay in the all server shutdown is actually caused by the server trying to flush all the cache and failing in the process. The attached server log shows the details. This goes on for 2 minutes and more before which the hudson kill kicks in and destroys the server because the build is complete (failed) by then. Dimitris Andreadis wrote: 2007-10-31 04:31:57,586 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] Stopping jboss.messaging:service=PostOffice 2007-10-31 04:31:57,586 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] org.jboss.messaging.core.jmx.MessagingPostOfficeService@f353e5 stopped 2007-10-31 04:31:57,915 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:31:57,915 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:31:57,915 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:31:57,916 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:31:57,916 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:31:57,916 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:02,917 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:02,917 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:02,917 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:02,918 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:02,918 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:02,918 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:07,919 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:07,920 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:07,920 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:07,920 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:07,920 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:07,920 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:12,921 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:12,921 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:12,921 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:12,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:12,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:12,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:17,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:17,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:17,923 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:17,925 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:17,925 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:17,925 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:20,561 WARN [org.jboss.ha.framework.server.JChannelFactory] Flush failed at 127.0.0.1:58939DefaultPartition-ClusteredSSOCache 2007-10-31 04:32:22,925 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:22,926 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:22,926 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:22,926 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:22,926 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:22,926 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:27,927 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:27,927 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:27,927 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:27,929 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:27,929 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:27,929 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:35,011 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:35,011 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:35,011 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:35,012 DEBUG [org.jboss.remoting.ServerInvoker] SocketServerInvoker[127.0.0.1:5150] stopped 2007-10-31 04:32:35,013 DEBUG [org.jboss.remoting.ServerInvoker] SocketServerInvoker[UNINITIALIZED] stopped 2007-10-31 04:32:35,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:35,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:35,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:40,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:40,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:40,014 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:40,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:40,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:40,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:45,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:45,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:45,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:45,017 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:45,018 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:45,018 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:46,594 WARN [org.jboss.ha.framework.server.JChannelFactory] Flush failed at 127.0.0.1:58939DefaultPartition-JMS-DATA 2007-10-31 04:32:50,019 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:50,019 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:50,019 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:50,019 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:50,020 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:50,020 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:32:55,021 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:00,023 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:00,023 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:00,024 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:00,024 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:00,024 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:00,024 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:05,025 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:05,025 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:05,025 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:05,025 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:05,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:05,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:08,892 DEBUG [com.arjuna.ats.arjuna.logging.arjLogger] Periodic recovery - first pass <Wed, 31 Oct 2007 04:33:08> 2007-10-31 04:33:08,892 DEBUG [com.arjuna.ats.arjuna.logging.arjLogger] StatusModule: first pass 2007-10-31 04:33:08,899 DEBUG [com.arjuna.ats.txoj.logging.txojLoggerI18N] [com.arjuna.ats.internal.txoj.recovery.TORecoveryModule_3] - TORecoveryModule - first pass 2007-10-31 04:33:08,900 DEBUG [com.arjuna.ats.jta.logging.loggerI18N] [com.arjuna.ats.internal.jta.recovery.info.firstpass] Local XARecoveryModule - first pass 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:10,026 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:11,620 WARN [org.jboss.ha.framework.server.JChannelFactory] Flush failed at 127.0.0.1:58939DefaultPartition-ClusteredSSOCache 2007-10-31 04:33:13,620 WARN [org.jboss.ha.framework.server.JChannelFactory] Flush failed at 127.0.0.1:58942DefaultPartition-JMS-CTRL 2007-10-31 04:33:15,028 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:15,028 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:15,028 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:15,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:15,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:15,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:16,623 INFO [org.jboss.cache.CacheImpl.DefaultPartition-ClusteredSSOCache] stop(): stopping the dispatcher 2007-10-31 04:33:18,903 DEBUG [com.arjuna.ats.arjuna.logging.arjLogger] Periodic recovery - second pass <Wed, 31 Oct 2007 04:33:18> 2007-10-31 04:33:18,903 DEBUG [com.arjuna.ats.arjuna.logging.arjLogger] AtomicActionRecoveryModule: Second pass 2007-10-31 04:33:18,903 DEBUG [com.arjuna.ats.txoj.logging.txojLoggerI18N] [com.arjuna.ats.internal.txoj.recovery.TORecoveryModule_6] - TORecoveryModule - second pass 2007-10-31 04:33:18,903 DEBUG [com.arjuna.ats.jta.logging.loggerI18N] [com.arjuna.ats.internal.jta.recovery.info.secondpass] Local XARecoveryModule - second pass 2007-10-31 04:33:19,680 DEBUG [org.jboss.messaging.core.impl.postoffice.MessagingPostOffice] org.jboss.messaging.core.impl.postoffice.MessagingPostOffice@86e54a stopped 2007-10-31 04:33:19,680 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] org.jboss.messaging.core.jmx.MessagingPostOfficeService@f353e5 stopped 2007-10-31 04:33:19,680 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] Stopped jboss.messaging:service=PostOffice 2007-10-31 04:33:19,681 DEBUG [org.jboss.jms.server.ServerPeer] Stopping jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,681 INFO [org.jboss.jms.server.ServerPeer] ServerPeer[0] is Stopping. NOTE! Stopping the server peer cleanly will NOT cause failover to occur 2007-10-31 04:33:19,681 DEBUG [org.jboss.jms.server.connectionfactory.ConnectionFactoryJNDIMapper] stopped 2007-10-31 04:33:19,681 WARN [org.jboss.jms.server.messagecounter.MessageCounterManager] org.jboss.jms.server.messagecounter.MessageCounterManager@1ed970f isn't started 2007-10-31 04:33:19,722 INFO [org.jboss.jms.server.ServerPeer] JMS ServerPeer[0] stopped 2007-10-31 04:33:19,722 DEBUG [org.jboss.jms.server.ServerPeer] Stopped jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,723 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,723 DEBUG [org.jboss.jms.server.destination.QueueService] Destroying jboss.messaging.destination:service=Queue,name=DLQ 2007-10-31 04:33:19,723 DEBUG [org.jboss.jms.server.destination.QueueService] Destroyed jboss.messaging.destination:service=Queue,name=DLQ 2007-10-31 04:33:19,723 DEBUG [org.jboss.jms.server.destination.QueueService] Destroying jboss.messaging.destination:service=Queue,name=ExpiryQueue 2007-10-31 04:33:19,723 DEBUG [org.jboss.jms.server.destination.QueueService] Destroyed jboss.messaging.destination:service=Queue,name=ExpiryQueue 2007-10-31 04:33:19,724 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] Destroying jboss.messaging:service=PostOffice 2007-10-31 04:33:19,724 DEBUG [org.jboss.messaging.core.jmx.MessagingPostOfficeService] Destroyed jboss.messaging:service=PostOffice 2007-10-31 04:33:19,726 DEBUG [org.jboss.jms.server.ServerPeer] Destroying jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,726 DEBUG [org.jboss.jms.server.ServerPeer] Destroyed jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,726 DEBUG [org.jboss.system.ServiceController] removing service: jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,727 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss.messaging:service=ServerPeer 2007-10-31 04:33:19,728 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss.messaging:service=ServerPeer from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/messaging/messaging-service.xml 2007-10-31 04:33:19,728 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=jacc,id=jbossws-context.war 2007-10-31 04:33:19,729 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=jacc,id=jbossws-context.war 2007-10-31 04:33:19,729 DEBUG [org.jboss.system.ServiceController] removing service: jboss:service=jacc,id=jbossws-context.war 2007-10-31 04:33:19,729 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss:service=jacc,id=jbossws-context.war 2007-10-31 04:33:19,729 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.web.deployment:war=/jbossws 2007-10-31 04:33:19,730 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] undeploy, ctxPath=/jbossws, vfsUrl=jbossws.sar/jbossws-context.war 2007-10-31 04:33:19,756 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.web.deployment:war=/jbossws 2007-10-31 04:33:19,756 DEBUG [org.jboss.system.ServiceController] removing service: jboss.web.deployment:war=/jbossws 2007-10-31 04:33:19,756 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss.web.deployment:war=/jbossws 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=jacc,id=jbossws.sar 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceController] Ignoring stop request for service: jboss:service=jacc,id=jbossws.sar at state DESTROYED 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=jacc,id=jbossws.sar 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss:service=jacc,id=jbossws.sar at state DESTROYED 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceController] removing service: jboss:service=jacc,id=jbossws.sar 2007-10-31 04:33:19,757 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss:service=jacc,id=jbossws.sar 2007-10-31 04:33:19,758 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss.web.deployment:war=/jbossws from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/jbossws-context.war/ 2007-10-31 04:33:19,758 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss:id=jbossws-context.war,service=jacc from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/jbossws-context.war/ 2007-10-31 04:33:19,759 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss:id=jbossws.sar,service=jacc from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,772 DEBUG [org.jboss.ws.extensions.eventing.mgmt.SubscriptionManager] Stop subscription manager 2007-10-31 04:33:19,773 DEBUG [org.jboss.ws.extensions.eventing.mgmt.SubscriptionManager] Destroy subscription manager 2007-10-31 04:33:19,774 DEBUG [org.jboss.wsf.framework.management.ManagedEndpointRegistry] Destroy service endpoint manager 2007-10-31 04:33:19,775 DEBUG [org.jboss.wsf.common.management.AbstractServerConfig] Using undefined host: jbossws.undefined.host 2007-10-31 04:33:19,777 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSServerConfig from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,777 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSEndpointRegistry from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,778 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSSubscriptionManager from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,778 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeContextPropertiesDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,778 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeEagerInitializeDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,779 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeEndpointHandlerDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,779 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeEventingDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,780 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativePublishContractDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,780 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeServiceEndpointInvokerDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,780 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeUnifiedMetaDataDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,781 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSJAXBIntroDeploymentAspect from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,781 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeDeploymentAspectInstallerPreJSE from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,781 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeDeploymentAspectInstallerPostJSE from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,782 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeDeploymentAspectInstallerEJB from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,782 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component WSNativeDeploymentAspectInstallerEndpointAPI from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/jbossws.sar/ 2007-10-31 04:33:19,783 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=jacc,id=web-console.war 2007-10-31 04:33:19,783 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=jacc,id=web-console.war 2007-10-31 04:33:19,783 DEBUG [org.jboss.system.ServiceController] removing service: jboss:service=jacc,id=web-console.war 2007-10-31 04:33:19,783 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss:service=jacc,id=web-console.war 2007-10-31 04:33:19,784 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.web.deployment:war=/web-console 2007-10-31 04:33:19,797 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] undeploy, ctxPath=/web-console, vfsUrl=management/console-mgr.sar/web-console.war 2007-10-31 04:33:19,817 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.web.deployment:war=/web-console 2007-10-31 04:33:19,817 DEBUG [org.jboss.system.ServiceController] removing service: jboss.web.deployment:war=/web-console 2007-10-31 04:33:19,817 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss.web.deployment:war=/web-console 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=jacc,id=console-mgr.sar 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] Ignoring stop request for service: jboss:service=jacc,id=console-mgr.sar at state DESTROYED 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=jacc,id=console-mgr.sar 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss:service=jacc,id=console-mgr.sar at state DESTROYED 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] removing service: jboss:service=jacc,id=console-mgr.sar 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss:service=jacc,id=console-mgr.sar 2007-10-31 04:33:19,818 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,818 DEBUG [org.jboss.console.manager.DeploymentFileRepository] Stopping jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.console.manager.DeploymentFileRepository] Stopped jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.console.manager.DeploymentFileRepository] Destroying jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.console.manager.DeploymentFileRepository] Destroyed jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.system.ServiceController] removing service: jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss.admin:service=DeploymentFileRepository 2007-10-31 04:33:19,819 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.console.manager.PluginManager] Stopping jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.console.manager.PluginManager] Stopped jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.console.manager.PluginManager] Destroying jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.console.manager.PluginManager] Destroyed jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.system.ServiceController] removing service: jboss.admin:service=PluginManager 2007-10-31 04:33:19,820 DEBUG [org.jboss.system.ServiceCreator] Removing mbean from server: jboss.admin:service=PluginManager 2007-10-31 04:33:19,821 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss.web.deployment:war=/web-console from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/management/console-mgr.sar/web-console.war/ 2007-10-31 04:33:19,822 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss:id=web-console.war,service=jacc from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/management/console-mgr.sar/web-console.war/ 2007-10-31 04:33:19,822 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss.admin:service=PluginManager from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/management/console-mgr.sar/ 2007-10-31 04:33:19,823 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss.admin:service=DeploymentFileRepository from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/management/console-mgr.sar/ 2007-10-31 04:33:19,823 DEBUG [org.jboss.deployers.structure.spi.helpers.AbstractDeploymentContext] Removed component jboss:id=console-mgr.sar,service=jacc from vfsfile:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy/management/console-mgr.sar/ 2007-10-31 04:33:19,828 DEBUG [org.jboss.deployers.plugins.deployers.DeployersImpl] Removed deployer org.jboss.resource.deployers.RARParserDeployer@1af9d1c from stage Parse 2007-10-31 04:33:19,828 DEBUG [org.jboss.deployers.plugins.deployers.DeployersImpl] Removed deployer org.jboss.resource.deployers.ManagedConnectionFactoryDeployer@178743b from stage Real 2007-10-31 04:33:19,830 DEBUG [org.jboss.deployers.plugins.deployers.DeployersImpl] Removed deployer org.jboss.resource.deployers.ManagedConnectionFactoryParserDeployer@1d479cf from stage Parse 2007-10-31 04:33:19,831 DEBUG [org.jboss.system.microcontainer.jmx.ServiceControllerLifecycleCallback] Unregistering MBean jboss.jca:service=JCAMetaDataRepository,name=DefaultJCAMetaDataRepository 2007-10-31 04:33:19,831 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.jca:service=JCAMetaDataRepository,name=DefaultJCAMetaDataRepository 2007-10-31 04:33:19,831 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=HASessionState 2007-10-31 04:33:19,831 DEBUG [org.jboss.ha.hasessionstate.server.HASessionStateService] Stopping jboss:service=HASessionState 2007-10-31 04:33:19,832 DEBUG [org.jboss.ha.hasessionstate.server.HASessionStateService] Stopped jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.ha.hasessionstate.server.HASessionStateService] Destroying jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.ha.hasessionstate.server.HASessionStateService] Destroyed jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.system.microcontainer.jmx.ServiceControllerLifecycleCallback] Unregistering MBean jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=HASessionState 2007-10-31 04:33:19,833 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss:service=HASessionState at state DESTROYED 2007-10-31 04:33:19,834 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=HAJNDI 2007-10-31 04:33:19,834 DEBUG [org.jboss.ha.jndi.HANamingService] Stopping jboss:service=HAJNDI 2007-10-31 04:33:19,834 DEBUG [org.jboss.ha.jndi.HANamingService] Closing the HAJNDI bootstrap listener 2007-10-31 04:33:19,834 DEBUG [org.jboss.ha.jndi.HANamingService] Stopping the HAJNDI service 2007-10-31 04:33:19,834 DEBUG [org.jboss.ha.jndi.HANamingService] Stopping AutomaticDiscovery 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.HANamingService] destroy ha rmiserver 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of DistributedReplicantManager._remove() is empty: no need to send message 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.DetachedHANamingService$AutomaticDiscovery] Discovery request thread end 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.framework.server.HARMIServerImpl$RefreshProxiesHATarget] Invocation authorization called: DISABLE_INVOCATIONS 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.HANamingService] Stopped jboss:service=HAJNDI 2007-10-31 04:33:19,840 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=HAJNDI 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.HANamingService] Destroying jboss:service=HAJNDI 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.HANamingService] Destroying the HAJNDI service 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.TreeHead] HAJNDI unregistering RPCHandler with HAPartition 2007-10-31 04:33:19,840 DEBUG [org.jboss.ha.jndi.HANamingService] Destroyed jboss:service=HAJNDI 2007-10-31 04:33:19,841 DEBUG [org.jboss.system.microcontainer.jmx.ServiceControllerLifecycleCallback] Unregistering MBean jboss:service=HAJNDI 2007-10-31 04:33:19,841 DEBUG [org.jboss.system.ServiceController] destroying service: jboss:service=HAJNDI 2007-10-31 04:33:19,841 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss:service=HAJNDI at state DESTROYED 2007-10-31 04:33:19,843 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,843 DEBUG [org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge] Stopping jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,843 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of DistributedReplicantManager._remove() is empty: no need to send message 2007-10-31 04:33:19,843 DEBUG [org.jboss.cache.invalidation.InvalidationManager] Unsubscription of a cache-invalidation bridge 2007-10-31 04:33:19,843 INFO [org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge] Problem while shuting down invalidation cache bridge java.lang.IllegalStateException: Cache not in STARTED state! at org.jboss.cache.CacheImpl.invokeMethod(CacheImpl.java:3929) at org.jboss.cache.CacheImpl.get(CacheImpl.java:1441) at org.jboss.cache.CacheImpl.get(CacheImpl.java:1415) at org.jboss.ha.framework.server.DistributedStateImpl.get(DistributedStateImpl.java:296) at org.jboss.ha.framework.server.DistributedStateImpl.remove(DistributedStateImpl.java:278) at org.jboss.ha.framework.server.AOPContainerProxy$4.remove(AOPContainerProxy$4.java) at org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge.stopService(JGCacheInvalidationBridge.java:326) at org.jboss.system.ServiceMBeanSupport.jbossInternalStop(ServiceMBeanSupport.java:328) at org.jboss.system.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java:247) at org.jboss.cache.invalidation.bridges.AOPContainerProxy$11.jbossInternalLifecycle(AOPContainerProxy$11.java) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:157) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:96) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668) at org.jboss.system.microcontainer.ServiceProxy.invoke(ServiceProxy.java:167) at $Proxy4.stop(Unknown Source) at org.jboss.system.microcontainer.StartStopLifecycleAction.uninstallAction(StartStopLifecycleAction.java:56) at org.jboss.system.microcontainer.StartStopLifecycleAction.uninstallAction(StartStopLifecycleAction.java:37) at org.jboss.dependency.plugins.action.SimpleControllerContextAction.simpleUninstallAction(SimpleControllerContextAction.java:79) at org.jboss.dependency.plugins.action.AccessControllerContextAction.uninstall(AccessControllerContextAction.java:131) at org.jboss.dependency.plugins.AbstractControllerContextActions.uninstall(AbstractControllerContextActions.java:58) at org.jboss.dependency.plugins.AbstractControllerContext.uninstall(AbstractControllerContext.java:333) at org.jboss.dependency.plugins.AbstractController.uninstall(AbstractController.java:1323) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:1009) at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:627) at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:411) at org.jboss.system.ServiceController.doChange(ServiceController.java:659) at org.jboss.system.ServiceController.stop(ServiceController.java:481) at sun.reflect.GeneratedMethodAccessor137.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:157) at org.jboss.mx.server.Invocation.dispatch(Invocation.java:96) at org.jboss.mx.server.Invocation.invoke(Invocation.java:88) at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:668) at org.jboss.system.ServiceMBeanSupport.stop(ServiceMBeanSupport.java:204) at org.jboss.cache.invalidation.bridges.AOPContainerProxy$11.stop(AOPContainerProxy$11.java) at sun.reflect.GeneratedMethodAccessor606.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.jboss.reflect.plugins.introspection.ReflectionUtils.invoke(ReflectionUtils.java:56) at org.jboss.reflect.plugins.introspection.ReflectMethodInfoImpl.invoke(ReflectMethodInfoImpl.java:110) at org.jboss.joinpoint.plugins.BasicMethodJoinPoint.dispatch(BasicMethodJoinPoint.java:66) at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.dispatchJoinPoint(KernelControllerContextAction.java:97) at org.jboss.kernel.plugins.dependency.LifecycleAction.uninstallActionInternal(LifecycleAction.java:249) at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.uninstallAction(KernelControllerContextAction.java:169) at org.jboss.kernel.plugins.dependency.KernelControllerContextAction.uninstallAction(KernelControllerContextAction.java:47) at org.jboss.dependency.plugins.action.SimpleControllerContextAction.simpleUninstallAction(SimpleControllerContextAction.java:79) at org.jboss.dependency.plugins.action.AccessControllerContextAction.uninstall(AccessControllerContextAction.java:131) at org.jboss.dependency.plugins.AbstractControllerContextActions.uninstall(AbstractControllerContextActions.java:58) at org.jboss.dependency.plugins.AbstractControllerContext.uninstall(AbstractControllerContext.java:333) at org.jboss.dependency.plugins.AbstractController.uninstall(AbstractController.java:1323) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:1009) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:936) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:986) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:936) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:986) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:936) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:986) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:936) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:986) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:936) at org.jboss.dependency.plugins.AbstractController.uninstall(AbstractController.java:463) at org.jboss.dependency.plugins.AbstractController.uninstall(AbstractController.java:426) at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.undeploy(BeanMetaDataDeployer.java:79) at org.jboss.deployers.vfs.deployer.kernel.BeanMetaDataDeployer.undeploy(BeanMetaDataDeployer.java:42) at org.jboss.deployers.spi.deployer.helpers.AbstractSimpleRealDeployer.undeploy(AbstractSimpleRealDeployer.java:73) at org.jboss.deployers.plugins.deployers.DeployerWrapper.undeploy(DeployerWrapper.java:187) at org.jboss.deployers.plugins.deployers.DeployersImpl.doUninstallParentLast(DeployersImpl.java:947) at org.jboss.deployers.plugins.deployers.DeployersImpl.doUninstallParentLast(DeployersImpl.java:940) at org.jboss.deployers.plugins.deployers.DeployersImpl.uninstall(DeployersImpl.java:902) at org.jboss.dependency.plugins.AbstractControllerContext.uninstall(AbstractControllerContext.java:333) at org.jboss.dependency.plugins.AbstractController.uninstall(AbstractController.java:1323) at org.jboss.dependency.plugins.AbstractController.uninstallContext(AbstractController.java:1009) at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:627) at org.jboss.dependency.plugins.AbstractController.change(AbstractController.java:411) at org.jboss.deployers.plugins.deployers.DeployersImpl.process(DeployersImpl.java:420) at org.jboss.deployers.plugins.main.MainDeployerImpl.process(MainDeployerImpl.java:354) at org.jboss.deployers.plugins.main.MainDeployerImpl.shutdown(MainDeployerImpl.java:382) at org.jboss.system.server.profileservice.ProfileServiceBootstrap.shutdown(ProfileServiceBootstrap.java:151) at org.jboss.bootstrap.AbstractServerImpl.shutdownServer(AbstractServerImpl.java:482) at org.jboss.bootstrap.AbstractServerImpl$ShutdownHook.run(AbstractServerImpl.java:778) 2007-10-31 04:33:19,845 DEBUG [org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge] Stopped jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge] Destroying jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.cache.invalidation.bridges.JGCacheInvalidationBridge] Destroyed jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.system.microcontainer.jmx.ServiceControllerLifecycleCallback] Unregistering MBean jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.cache:service=InvalidationBridge,type=JavaGroups 2007-10-31 04:33:19,846 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss.cache:service=InvalidationBridge,type=JavaGroups at state DESTROYED 2007-10-31 04:33:19,847 DEBUG [org.jboss.system.ServiceController] stopping service: jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of HASingletonDeployer._receiveRemoteNotification() is empty: no need to send message 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] Stopping jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] stop HAServiceMBeanSupport 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of DistributedReplicantManager._remove() is empty: no need to send message 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] partitionTopologyChanged, isElectedNewMaster=false, isMasterNode=true, viewID=0 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] _stopOldMaster, isMasterNode=true 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] stopSingleton() : another node in the partition (if any) is elected for master 2007-10-31 04:33:19,847 DEBUG [org.jboss.ha.singleton.HASingletonController] Calling operation: undeploySingletons(file:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy-hasingleton), on target: 'HASingletonDeploymentScanner@9faafc{}' 2007-10-31 04:33:19,848 DEBUG [org.jboss.ha.singleton.HASingletonDeploymentScanner] Removed URI: file:/qa/services/hudson/hudson_workspace/workspace/JBoss-AS-5.0.x-TestSuite-sun15-noip/trunk/build/output/jboss-5.0.0.Beta3/server/all/deploy-hasingleton 2007-10-31 04:33:19,848 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of HASingletonDeployer._receiveRemoteNotification() is empty: no need to send message 2007-10-31 04:33:19,848 DEBUG [org.jboss.ha.singleton.HASingletonController] Stopped jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.ha.singleton.HASingletonController] Destroying jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.ha.singleton.HASingletonController] Destroyed jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.system.microcontainer.jmx.ServiceControllerLifecycleCallback] Unregistering MBean jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.system.ServiceController] destroying service: jboss.ha:service=HASingletonDeployer 2007-10-31 04:33:19,849 DEBUG [org.jboss.system.ServiceController] Ignoring destroy request for service: jboss.ha:service=HASingletonDeployer at state DESTROYED 2007-10-31 04:33:19,850 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] Stopping jboss.test:service=ProxyFactory,name=HAService,protocol=jrmpha 2007-10-31 04:33:19,851 DEBUG [org.jboss.ha.framework.server.ClusterPartition$RpcHandler] destination list of DistributedReplicantManager._remove() is empty: no need to send message 2007-10-31 04:33:19,851 DEBUG [org.jboss.test.cluster.invokerha.HAService] partitionTopologyChanged(). cluster view id: 0 2007-10-31 04:33:19,851 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] Rebinding in JNDI... jboss.test:service=HAService 2007-10-31 04:33:19,851 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] (re-)Binding jmx/HAService 2007-10-31 04:33:19,851 DEBUG [org.jboss.ha.framework.server.HATarget] Invocation authorization called: DISABLE_INVOCATIONS 2007-10-31 04:33:19,851 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] Stopped jboss.test:service=ProxyFactory,name=HAService,protocol=jrmpha 2007-10-31 04:33:19,852 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] About to stop: disabling remote access to mbean jboss.test:service=HAService 2007-10-31 04:33:19,852 DEBUG [org.jboss.ha.framework.server.HATarget] Invocation authorization called with no-op 2007-10-31 04:33:19,852 DEBUG [org.jboss.ha.framework.server.HATarget] Disabled called on HATarget 2007-10-31 04:33:19,852 DEBUG [org.jboss.test.cluster.invokerha.HAService] Stopping jboss.test:service=HAService 2007-10-31 04:33:19,852 DEBUG [org.jboss.test.cluster.invokerha.HAService] stop HAServiceMBeanSupport 2007-10-31 04:33:19,852 DEBUG [org.jboss.test.cluster.invokerha.HAService] Stopped jboss.test:service=HAService 2007-10-31 04:33:19,852 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] Destroying jboss.test:service=ProxyFactory,name=HAService,protocol=jrmpha 2007-10-31 04:33:19,852 DEBUG [org.jboss.proxy.generic.ProxyFactoryHA] Destroyed jboss.test:service=ProxyFactory,name=HAService,protocol=jrmpha 2007-10-31 04:33:19,853 DEBUG [org.jboss.test.cluster.invokerha.HAService] Destroying jboss.test:service=HAService 2007-10-31 04:33:19,853 DEBUG [org.jboss.test.cluster.invokerha.HAService] Destroyed jboss.test:service=HAService 2007-10-31 04:33:19,856 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=invoker,type=pooledha 2007-10-31 04:33:19,856 DEBUG [org.jboss.invocation.pooled.server.PooledInvokerHA] Stopping jboss:service=invoker,type=pooledha 2007-10-31 04:33:19,856 DEBUG [org.jboss.invocation.pooled.server.PooledInvokerHA] Stopped jboss:service=invoker,type=pooledha 2007-10-31 04:33:19,857 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=invoker,type=jrmpha 2007-10-31 04:33:19,857 DEBUG [org.jboss.invocation.jrmp.server.JRMPInvokerHA] Stopping jboss:service=invoker,type=jrmpha 2007-10-31 04:33:19,857 DEBUG [org.jboss.invocation.jrmp.server.JRMPInvokerHA] Stopped jboss:service=invoker,type=jrmpha 2007-10-31 04:33:19,858 DEBUG [org.jboss.system.ServiceController] stopping service: jboss:service=invoker,type=unifiedha 2007-10-31 04:33:19,859 DEBUG [org.jboss.invocation.unified.server.UnifiedInvokerHA] Stopping jboss:service=invoker,type=unifiedha 2007-10-31 04:33:19,859 DEBUG [org.jboss.remoting.ServerInvoker] SocketServerInvoker[127.0.0.1:4446] stopped 2007-10-31 04:33:19,859 DEBUG [org.jboss.invocation.unified.server.UnifiedInvokerHA] Stopped jboss:service=invoker,type=unifiedha 2007-10-31 04:33:19,861 DEBUG [org.jboss.ha.framework.server.ClusterPartition] Stopping ClusterPartition 2007-10-31 04:33:19,862 INFO [org.jboss.ha.framework.interfaces.HAPartition.DefaultPartition] Stopping partition DefaultPartition 2007-10-31 04:33:19,864 DEBUG [org.jboss.ha.framework.server.ClusterPartition.AsynchViewChangeHandler] AsynchViewChangeHandler Thread interrupted 2007-10-31 04:33:19,864 DEBUG [org.jboss.ha.framework.server.ClusterPartition.AsynchViewChangeHandler] End AsynchViewChangeHandler Thread 2007-10-31 04:33:19,864 DEBUG [org.jboss.remoting.transport.socket.SocketServerInvoker] SocketServerInvoker[127.0.0.1:4446] caught exception in run() java.net.SocketException: Socket closed at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.jboss.remoting.transport.socket.SocketServerInvoker.run(SocketServerInvoker.java:520) at java.lang.Thread.run(Thread.java:595) 2007-10-31 04:33:19,865 DEBUG [org.jboss.ha.framework.server.DistributedReplicantManagerImpl.AsynchKeyChangeHandler] AsynchKeyChangeHandler Thread interrupted 2007-10-31 04:33:19,865 DEBUG [org.jboss.ha.framework.server.DistributedReplicantManagerImpl.AsynchKeyChangeHandler] End AsynchKeyChangeHandler Thread 2007-10-31 04:33:20,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:20,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:20,029 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:20,031 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:20,031 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:20,031 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:25,032 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:25,032 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:25,032 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:25,032 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:25,033 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:25,033 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:30,034 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:36,748 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:36,748 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:36,748 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:36,749 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:36,749 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:36,749 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:39,757 WARN [org.jboss.ha.framework.server.JChannelFactory] Flush failed at 127.0.0.1:58939DefaultPartition-HAPartitionCache 2007-10-31 04:33:41,750 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:41,750 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:41,750 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:41,751 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:41,751 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:41,751 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:46,752 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:46,752 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:46,752 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty 2007-10-31 04:33:46,754 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] process(): region: / 2007-10-31 04:33:46,754 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] processed 0 node events in region: / 2007-10-31 04:33:46,754 DEBUG [org.jboss.cache.eviction.BaseEvictionAlgorithm] Recycle queue is empty

A failed flush could also be caused by reincarnation (http://jira.jboss.com/jira/browse/JGRP-130), especially when killing and restarting a server with a rather long timeout in FD. JGroups 2.5.2/2.6-CR-1 fixed this by simply rejecting a member who crashed, but was not removed, and wants to join the same group under the same address and port. What version of JGroups is AS 5 running with ? Brian Stansberry wrote: -- Bela Ban Lead JGroups / Clustering Team JBoss - a division of Red Hat

Since the JBoss-AS-5.0.x-TestSuite-sun15 suite completes (vs the JBoss-AS-5.0.x-TestSuite-sun15-noip that is stuck with start/stop problems) I think we should focus on exactly what's different between the two setups. We've said before that we want to get rid of the 'noip' version, like in Branch_4_2, so let's do that. Brian Stansberry wrote:

Multicast isn't working properly on the loopback interface on dev90 (and probably on other servers in the QA lab). I've filed a ticket with helpdesk. Brian Stansberry wrote: -- Brian Stansberry Lead, AS Clustering JBoss, a division of Red Hat brian.stansberry(a)redhat.com

Dimitris Andreadis wrote: We are working with Brian today to track down this problem. I don't think it works. The problem is we don't have a good replacement. IE, a reliable, cross-platform way to manage and kill processes from java. Does any exist which doesn't require native code? My google search says no. So unless someone beats me over the head with an alternative, we'll keep calling process.destroy in vain. But the real intent of JBAS-2235 is to fail the build upon server shutdown failure which is not affected by the above discussion. I'll find someone to do it or <sigh> do it myself. Ryan

Same issue there as with http://dev45.qa.atl.jboss.com:8585/hudson : the server never responds when you request http://hudson.qa.jboss.com/hudson/job/JBoss-AS-5.0.x-TestSuite-sun15-noip... Rajesh Rajasekaran wrote: -- Brian Stansberry Lead, AS Clustering JBoss, a division of Red Hat brian.stansberry(a)redhat.com

Brian, Having said that server logs are available because they are marked as build artifcat. Please see http://hudson.qa.jboss.com/hudson/view/JBoss%20AS/job/JBoss-AS-5.0.x-Test.... I was able to access it. You can access this from public URL as well which is http://hudson.jboss.org/hudson/view/JBoss%20AS/job/JBoss-AS-5.0.x-TestSui.... These are also permlinks in case you want them. I hope this helps. Prabhat Jha wrote:

Rajesh, Did not we have this problem before when tests that ran later with all configuration were cleaing server.log from server/all/log? I see all other logs but server.log in server/all/log. Brian, I do see server.log from other test server configurations for example cluster-tcp-SYNC-0 configs. http://hudson.jboss.org/hudson/view/JBoss%20AS/job/JBoss-AS-5.0.x-TestSui... Regards, Prabhat Brian Stansberry wrote:

What I see is when I start a clustered server using the <server:start tag, I get a very slow startup and lots of those cache messages on the log... and shutdown won't work. However if I start the same server manually, everything works fine. Rajesh Rajasekaran wrote:

Never mind this, Clebert; I've got a log. Brian Stansberry wrote: -- Brian Stansberry Lead, AS Clustering JBoss, a division of Red Hat brian.stansberry(a)redhat.com