[infinispan-issues] [JBoss JIRA] (ISPN-5525) Server deadlock on stop

Server deadlock on stop ----------------------- Key: ISPN-5525 URL: https://issues.jboss.org/browse/ISPN-5525 Project: Infinispan Issue Type: Bug Components: Server, Test Suite - Server Affects Versions: 7.2.2.Final, 8.0.0.Alpha1 Reporter: Gustavo Fernandes Infinispan server is hanging intermittently during stop causing the build to timeout after 3h. This can be seen in the CI builds, for example: http://ci.infinispan.org/viewLog.html?buildId=27005&tab=buildResultsD... http://ci.infinispan.org/viewLog.html?buildId=26651&buildTypeId=Infin... In all case the deadlock is detected: {code} Found one Java-level deadlock: ============================= "undefined": waiting to lock monitor 0x00007fbaa806d448 (object 0x00000000e0a5a6f8, a org.jboss.as.threads.ScheduledThreadPoolService), which is held by "MSC service thread 1-2" "MSC service thread 1-2": waiting for ownable synchronizer 0x00000000e0a5a680, (a java.util.concurrent.locks.ReentrantLock$NonfairSync), which is held by "undefined" Java stack information for the threads listed above: =================================================== "undefined": at org.jboss.as.threads.ScheduledThreadPoolService$ExecutorImpl.terminated(ScheduledThreadPoolService.java:121) - waiting to lock <0x00000000e0a5a6f8> (a org.jboss.as.threads.ScheduledThreadPoolService) at java.util.concurrent.ThreadPoolExecutor.tryTerminate(ThreadPoolExecutor.java:706) at java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1007) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) at org.jboss.threads.JBossThread.run(JBossThread.java:122) "MSC service thread 1-2": at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000e0a5a680> (a java.util.concurrent.locks.ReentrantLock$NonfairSync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285) at java.util.concurrent.ThreadPoolExecutor.interruptIdleWorkers(ThreadPoolExecutor.java:783) at java.util.concurrent.ThreadPoolExecutor.tryTerminate(ThreadPoolExecutor.java:697) at java.util.concurrent.ThreadPoolExecutor.shutdown(ThreadPoolExecutor.java:1394) at java.util.concurrent.ScheduledThreadPoolExecutor.shutdown(ScheduledThreadPoolExecutor.java:761) at org.jboss.as.threads.ManagedScheduledExecutorService.internalShutdown(ManagedScheduledExecutorService.java:53) at org.jboss.as.threads.ScheduledThreadPoolService.stop(ScheduledThreadPoolService.java:67) - locked <0x00000000e0a5a6f8> (a org.jboss.as.threads.ScheduledThreadPoolService) at org.jboss.msc.service.ServiceControllerImpl$StopTask.stopService(ServiceControllerImpl.java:2056) at org.jboss.msc.service.ServiceControllerImpl$StopTask.run(ServiceControllerImpl.java:2017) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Found 1 deadlock. {code}