[ https://issues.jboss.org/browse/ISPN-972?page=com.atlassian.jira.plugin.s... ] Galder Zamarreño updated ISPN-972: ---------------------------------- Description: http://hudson.qa.jboss.com/hudson/job/edg-51x-resilience-client-size4-hot... is showing: {code}[JBoss] 08:50:03,207 INFO [DistributionManagerImpl] Detected a view change. Member list changed from [perf02-63027, perf04-63783, perf03-36672, perf01-30087] to [perf04-63783, perf03-36672, perf01-30087] [JBoss] 08:50:03,207 INFO [DistributionManagerImpl] This is a LEAVE event! Node perf02-63027 has just left [JBoss] 08:50:03,208 INFO [DistributionManagerImpl] I perf01-30087 am participating in rehash, state providers [perf03-36672, perf01-30087], state receivers [perf04-63783, perf03-36672] [JBoss] 08:50:03,408 INFO [InboundInvocationHandlerImpl] Will try and wait for the cache to start [JBoss] 08:50:03,554 ERROR [JoinTask] Caught exception! [JBoss] java.util.concurrent.ExecutionException: org.infinispan.remoting.RpcException: Expected just one response; got {} instead! [JBoss] at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) [JBoss] at java.util.concurrent.FutureTask.get(FutureTask.java:83) [JBoss] at org.infinispan.distribution.JoinTask.performRehash(JoinTask.java:100) [JBoss] at org.infinispan.distribution.RehashTask.call(RehashTask.java:75) [JBoss] at org.infinispan.distribution.RehashTask.call(RehashTask.java:41) [JBoss] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [JBoss] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [JBoss] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [JBoss] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [JBoss] at java.lang.Thread.run(Thread.java:619) [JBoss] Caused by: org.infinispan.remoting.RpcException: Expected just one response; got {} instead! [JBoss] at org.infinispan.distribution.RemoteTransactionLoggerImpl.extractRemoteTransactionLogDetails(RemoteTransactionLoggerImpl.java:41) [JBoss] at org.infinispan.distribution.RemoteTransactionLoggerImpl.drain(RemoteTransactionLoggerImpl.java:53) [JBoss] at org.infinispan.distribution.DistributionManagerImpl.drainLocalTransactionLog(DistributionManagerImpl.java:636) [JBoss] at org.infinispan.distribution.DistributionManagerImpl.applyState(DistributionManagerImpl.java:542) [JBoss] at org.infinispan.distribution.RehashTask$StateGrabber.call(RehashTask.java:143) [JBoss] at org.infinispan.distribution.RehashTask$StateGrabber.call(RehashTask.java:125) [JBoss] ... 5 more{code} was: http://hudson.qa.jboss.com/hudson/job/edg-51x-resilience-client-size4-hot... is showing: [JBoss] 08:50:03,207 INFO [DistributionManagerImpl] Detected a view change. Member list changed from [perf02-63027, perf04-63783, perf03-36672, perf01-30087] to [perf04-63783, perf03-36672, perf01-30087] [JBoss] 08:50:03,207 INFO [DistributionManagerImpl] This is a LEAVE event! Node perf02-63027 has just left [JBoss] 08:50:03,208 INFO [DistributionManagerImpl] I perf01-30087 am participating in rehash, state providers [perf03-36672, perf01-30087], state receivers [perf04-63783, perf03-36672] [JBoss] 08:50:03,408 INFO [InboundInvocationHandlerImpl] Will try and wait for the cache to start [JBoss] 08:50:03,554 ERROR [JoinTask] Caught exception! [JBoss] java.util.concurrent.ExecutionException: org.infinispan.remoting.RpcException: Expected just one response; got {} instead! [JBoss] at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) [JBoss] at java.util.concurrent.FutureTask.get(FutureTask.java:83) [JBoss] at org.infinispan.distribution.JoinTask.performRehash(JoinTask.java:100) [JBoss] at org.infinispan.distribution.RehashTask.call(RehashTask.java:75) [JBoss] at org.infinispan.distribution.RehashTask.call(RehashTask.java:41) [JBoss] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) [JBoss] at java.util.concurrent.FutureTask.run(FutureTask.java:138) [JBoss] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [JBoss] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [JBoss] at java.lang.Thread.run(Thread.java:619) [JBoss] Caused by: org.infinispan.remoting.RpcException: Expected just one response; got {} instead! [JBoss] at org.infinispan.distribution.RemoteTransactionLoggerImpl.extractRemoteTransactionLogDetails(RemoteTransactionLoggerImpl.java:41) [JBoss] at org.infinispan.distribution.RemoteTransactionLoggerImpl.drain(RemoteTransactionLoggerImpl.java:53) [JBoss] at org.infinispan.distribution.DistributionManagerImpl.drainLocalTransactionLog(DistributionManagerImpl.java:636) [JBoss] at org.infinispan.distribution.DistributionManagerImpl.applyState(DistributionManagerImpl.java:542) [JBoss] at org.infinispan.distribution.RehashTask$StateGrabber.call(RehashTask.java:143) [JBoss] at org.infinispan.distribution.RehashTask$StateGrabber.call(RehashTask.java:125) [JBoss] ... 5 more -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/ISPN-972?page=com.atlassian.jira.plugin.s... ] Manik Surtani commented on ISPN-972: ------------------------------------ @Galder do you have logs from [perf03-36672, perf01-30087], corresponding to the exception thrown? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/ISPN-972?page=com.atlassian.jira.plugin.s... ] Manik Surtani updated ISPN-972: ------------------------------- Summary: RemoteTransactionLoggerImpl should handle RPC errors better (was: Rehashing failing in RemoteTransactionLoggerImpl) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/ISPN-972?page=com.atlassian.jira.plugin.s... ] Manik Surtani resolved ISPN-972. -------------------------------- Resolution: Done -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/ISPN-972?page=com.atlassian.jira.plugin.s... ] Radoslav Husar commented on ISPN-972: ------------------------------------- Yes, the clocks are synced. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira