Undertow request failed HttpServerExchange due to replication timeout --------------------------------------------------------------------- Key: WFLY-7274 URL: https://issues.jboss.org/browse/WFLY-7274 Project: WildFly Issue Type: Bug Components: Clustering Affects Versions: 10.1.0.Final Reporter: Paul Ferraro Assignee: Paul Ferraro Occured on server during eap-7x-failover-ejb-ejbservlet-shutdown-dist-async scenario. Server log stacktrace: {code} 15:29:15,717 WARN [org.jboss.weld.Servlet] (default task-104) WELD-000717: Unable to deactivate context org.jboss.weld.context.http.HttpSessionContextImpl@351bc717 when destroying request HttpServletRequestImpl [ GET /clusterbench/ejbservlet ] [JBossINF] 15:29:15,718 ERROR [io.undertow.request] (default task-104) UT005071: Undertow request failed HttpServerExchange{ GET /clusterbench/ejbservlet request {Cookie=[$Version=0; JSESSIONID=YiEdTzoqqzKiWxjI1VqEQNz8BB0id8L6GKrA1Uix.dev215; $Path=/clusterbench], Content-Length=[0], User-Agent=[Jakarta Commons-HttpClient/3.1], Host=[dev220:8080]} response {Set-Cookie=[JSESSIONID=YiEdTzoqqzKiWxjI1VqEQNz8BB0id8L6GKrA1Uix.dev213; path=/clusterbench], Content-Type=[text/html;charset=UTF-8], Content-Length=[80], Date=[Wed, 21 Sep 2016 19:29:00 GMT]}}: org.infinispan.util.concurrent.TimeoutException: Replication timeout for dev213 [JBossINF] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.checkRsp(JGroupsTransport.java:801) [JBossINF] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.lambda$invokeRemotelyAsync$1(JGroupsTransport.java:642) [JBossINF] at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) [JBossINF] at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) [JBossINF] at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) [JBossINF] at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) [JBossINF] at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:47) [JBossINF] at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:16) [JBossINF] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [JBossINF] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [JBossINF] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [JBossINF] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [JBossINF] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [JBossINF] at java.lang.Thread.run(Thread.java:745) {code} Followed by: {code} 15:29:15,720 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (remote-thread--p7-t17) ISPN000136: Error executing command LockControlCommand, writing keys []: org.infinispan.util.concurrent.TimeoutException: Could not acquire lock on SessionCreationMetaDataKey(bprpzS1jzQGMjU9vmr1uwUvsN0ehaPpWtpRQYUhA) in behalf of transaction GlobalTransaction:<dev213>:108660:remote. Current owner GlobalTransaction:<dev213>:90576:remote. [JBossINF] at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager.timeout(DefaultPendingLockManager.java:261) ... {code} or: {code} 15:29:19,720 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (default task-54) ISPN000136: Error executing command GetKeyValueCommand, writing keys []: org.infinispan.util.concurrent.TimeoutException: Could not acquire lock on SessionCreationMetaDataKey(bprpzS1jzQGMjU9vmr1uwUvsN0ehaPpWtpRQYUhA) in behalf of transaction GlobalTransaction:<dev215>:112942:local. Current owner GlobalTransaction:<dev213>:90576:remote. [JBossINF] at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager.timeout(DefaultPendingLockManager.java:261) ... {code} Server logs: http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-7x-failover-ejb-e...