Failing test in Query module
by Anna Manukyan
Hi all,
I've just updated my Infinispan fork, and after running the tests for query module, found out that the org.infinispan.query.distributed.MultiNodeReplicatedTest.testIndexingWorkDistribution() is failing constantly.
Just wanted to ask whether anyone is looking into it?
The failure message is:
org.infinispan.remoting.transport.jgroups.SuspectException: Suspected member: MultiNodeReplicatedTest-NodeD-48101
at org.infinispan.remoting.transport.AbstractTransport.parseResponseAndAddToResponseList(AbstractTransport.java:102)
at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:541)
at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:179)
at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:201)
at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:258)
at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:245)
at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:240)
at org.infinispan.remoting.rpc.RpcManagerImpl.broadcastRpcCommand(RpcManagerImpl.java:219)
at org.infinispan.remoting.rpc.RpcManagerImpl.broadcastRpcCommand(RpcManagerImpl.java:211)
at org.infinispan.interceptors.ReplicationInterceptor.handleCrudMethod(ReplicationInterceptor.java:273)
at org.infinispan.interceptors.ReplicationInterceptor.visitPutKeyValueCommand(ReplicationInterceptor.java:242)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.interceptors.EntryWrappingInterceptor.invokeNextAndApplyChanges(EntryWrappingInterceptor.java:249)
at org.infinispan.interceptors.EntryWrappingInterceptor.visitPutKeyValueCommand(EntryWrappingInterceptor.java:162)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.query.backend.QueryInterceptor.visitPutKeyValueCommand(QueryInterceptor.java:127)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitPutKeyValueCommand(NonTransactionalLockingInterceptor.java:82)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132)
at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:62)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:215)
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:193)
at org.infinispan.statetransfer.StateTransferInterceptor.visitPutKeyValueCommand(StateTransferInterceptor.java:136)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:127)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:128)
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:92)
at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:62)
at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:343)
at org.infinispan.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1146)
at org.infinispan.CacheImpl.putInternal(CacheImpl.java:744)
at org.infinispan.CacheImpl.put(CacheImpl.java:738)
at org.infinispan.CacheImpl.put(CacheImpl.java:732)
at org.infinispan.CacheSupport.put(CacheSupport.java:53)
at org.infinispan.query.distributed.MultiNodeDistributedTest.storeOn(MultiNodeDistributedTest.java:73)
at org.infinispan.query.distributed.MultiNodeDistributedTest.testIndexingWorkDistribution(MultiNodeDistributedTest.java:98)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:715)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:907)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1237)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:334)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:37)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:368)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Thanks in advance.
Best regards,
Anna.
12 years
Server Jira component
by Tristan Tarrant
Hi all,
I finally went ahead and created the "Server" component on Jira to hold
all issues related to the AS-based Infinispan Server (aka JDG server).
I have renamed the previous "Servers" component to a more appropriate
"Remote Protocols".
A note about versions: Server versions will be aligned with Library
versions, but because of the nature of how the server is built and its
dependency on an Infinispan library release, a Server release will
happen asynchronously (i.e. a couple of days later). Also we may not
want Server issues in the Library release notes. How should we handle this ?
Tristan
12 years
Scala plugin blog
by Navin Surtani
Hey all,
Galder and I had a conversation about me putting up a blog on how to make IntelliJ work with the Scala plugin properly. Initially I had a bunch of compile errors and issues that he very kindly helped me fix. I should hopefully get a little bit of time soon to be able to put it together properly. So, that brings me to two questions:
(1) - Should this be on the Infinispan wiki or just a blog on jboss.org? (or on the Infinispan blog)
(2) - Should there be a JIRA for this?
Thanks!
------------------------
Navin Surtani
Software Engineer
JBoss SET
JBoss EAP
Twitter: @navssurtani
12 years
Put issues with newly joining node
by Galder Zamarreño
Hey Dan/Adrian,
Re: https://issues.jboss.org/browse/ISPN-2541
I'm looking at this intermittent failure, and it seems to be caused by the fact that the test does not wait for the cluster to be formed when the new node is started, which can lead a replication timeout failure from the new joining node.
The test can easily be fixed by waiting for cluster to form, and then do the call.
But, I think there's an underlying issue, which I'm not sure if it has been fixed already:
Node A sends a put to Node-B and newly joined Node-C:
test.log:11206:2012-11-23 09:11:29,925 148390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng-MarshallExternalPojosTest:org.infinispan.marshall.MarshallExternalPojosTest) dests=null, command=SingleRpcCommand{cacheName='org.infinispan.marshall.MarshallExternalPojosTest', command=PutKeyValueCommand{key=k0-testReplicateJBossExternalizePojoToNewJoiningNode, value=org.infinispan.marshall.PojoWithJBossExternalize@413f7ce9, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}}, mode=SYNCHRONOUS, timeout=15000
Node-C receives the put request but it's in the middle of state transfer, so it forwards it to node B:
2012-11-23 09:11:29,960 148425 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (OOB-2,ISPN,MarshallExternalPojosTest-NodeC-10724:org.infinispan.marshall.MarshallExternalPojosTest) Forwarding command PutKeyValueCommand{key=k0-testReplicateJBossExternalizePojoToNewJoiningNode, value=org.infinispan.marshall.PojoWithJBossExternalize@413f7ce9, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1} to new targets [MarshallExternalPojosTest-NodeB-22814]
2012-11-23 09:11:29,960 148425 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,ISPN,MarshallExternalPojosTest-NodeC-10724:org.infinispan.marshall.MarshallExternalPojosTest) MarshallExternalPojosTest-NodeC-10724 broadcasting call PutKeyValueCommand{key=k0-testReplicateJBossExternalizePojoToNewJoiningNode, value=org.infinispan.marshall.PojoWithJBossExternalize@413f7ce9, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1} to recipient list [MarshallExternalPojosTest-NodeB-22814]
At the same time, Node-B is forwarding the request to Node-C:
2012-11-23 09:11:29,965 148430 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (OOB-2,ISPN,MarshallExternalPojosTest-NodeB-22814:org.infinispan.marshall.MarshallExternalPojosTest) Forwarding command PutKeyValueCommand{key=k0-testReplicateJBossExternalizePojoToNewJoiningNode, value=org.infinispan.marshall.PojoWithJBossExternalize@413f7ce9, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1} to new targets [MarshallExternalPojosTest-NodeC-10724]
In the end, Node-A does not get a reply from Node-C:
2012-11-23 09:11:44,960 163425 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng-MarshallExternalPojosTest:org.infinispan.marshall.MarshallExternalPojosTest) Responses: [sender=MarshallExternalPojosTest-NodeC-10724, received=false, suspected=false]
Does this ring a bell?
Cheers,
--
Galder Zamarreño
galder(a)redhat.com
twitter.com/galderz
Project Lead, Escalante
http://escalante.io
Engineer, Infinispan
http://infinispan.org
12 years, 1 month
