[infinispan-issues] [JBoss JIRA] (ISPN-4772) APIDistTest random failures

[Dan Berindei (JIRA)]

     [ https://issues.jboss.org/browse/ISPN-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Berindei reopened ISPN-4772:
--------------------------------


Got another failure in {{ReplWriteSkewAtomicMapAPITest.testConcurrentWritesAndIteration}}:

{noformat}
00:12:22,526 TRACE (ForkThread-1,ReplWriteSkewAtomicMapAPITest:[]) [RpcManagerImpl] NodeA-24638 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeA-24638:41063, cacheName=atomic}  to recipient list null with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS}
...
00:12:22,633 TRACE (remote-thread-NodeB-p44669-t5:[]) [TxCompletionNotificationCommand] Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeA-24638:41063. Affected keys: [testConcurrentWritesAndIteration]
...
00:12:22,638 ERROR (remote-thread-NodeC-p44691-t6:[]) [InvocationContextInterceptor] ISPN000136: Error executing command VersionedPrepareCommand, writing keys [testConcurrentWritesAndIteration]
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 100 milliseconds for key testConcurrentWritesAndIteration and requestor GlobalTx:NodeA-24638:41069. Lock is held by GlobalTx:NodeA-24638:41063
	at org.infinispan.util.concurrent.locks.impl.DefaultLockManager$KeyAwareExtendedLockPromise.lock(DefaultLockManager.java:238) ~[classes/:?]
	at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockAllAndRecord(AbstractLockingInterceptor.java:210) ~[classes/:?]
	at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.checkPendingAndLockAllKeys(AbstractTxLockingInterceptor.java:180) ~[classes/:?]
	at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockAllOrRegisterBackupLock(AbstractTxLockingInterceptor.java:146) ~[classes/:?]
	at org.infinispan.interceptors.locking.OptimisticLockingInterceptor.visitPrepareCommand(OptimisticLockingInterceptor.java:71) ~[classes/:?]
	at org.infinispan.interceptors.locking.OptimisticLockingInterceptor.visitPrepareCommand(OptimisticLockingInterceptor.java:33) ~[classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:176) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:49) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) ~[classes/:?]
	at org.infinispan.interceptors.impl.TxInterceptor.handlePrepareCommand(TxInterceptor.java:138) ~[classes/:?]
	at org.infinispan.interceptors.impl.TxInterceptor.visitPrepareCommand(TxInterceptor.java:127) ~[classes/:?]
	at org.infinispan.interceptors.impl.TxInterceptor.visitPrepareCommand(TxInterceptor.java:85) ~[classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:176) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:49) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAsync(BaseAsyncInterceptor.java:97) ~[classes/:?]
	at org.infinispan.statetransfer.TransactionSynchronizerInterceptor.visitCommand(TransactionSynchronizerInterceptor.java:47) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) ~[classes/:?]
	at org.infinispan.statetransfer.StateTransferInterceptor.handleTxCommand(StateTransferInterceptor.java:245) ~[classes/:?]
	at org.infinispan.statetransfer.StateTransferInterceptor.visitPrepareCommand(StateTransferInterceptor.java:83) ~[classes/:?]
	at org.infinispan.statetransfer.StateTransferInterceptor.visitPrepareCommand(StateTransferInterceptor.java:64) ~[classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:176) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:49) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:53) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:127) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:45) ~[classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:176) ~[classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:49) ~[classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) ~[classes/:?]
	at org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:103) [classes/:?]
	at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:52) [classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:53) [classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:127) [classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:45) [classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:176) [classes/:?]
	at org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:49) [classes/:?]
	at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invokeAsync(AsyncInterceptorChainImpl.java:233) [classes/:?]
	at org.infinispan.commands.tx.PrepareCommand.invokeAsync(PrepareCommand.java:100) [classes/:?]
	at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokeCommand(BasePerCacheInboundInvocationHandler.java:82) [classes/:?]
	at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:45) [classes/:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_45]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_45]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
00:12:22,660 ERROR (testng-ReplWriteSkewAtomicMapAPITest:[]) [TestSuiteProgress] Test failed: org.infinispan.atomic.ReplWriteSkewAtomicMapAPITest.testConcurrentWritesAndIteration
java.util.concurrent.ExecutionException: org.infinispan.commons.CacheException: Unable to end batch
	at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_45]
	at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[?:1.8.0_45]
	at org.infinispan.atomic.BaseAtomicHashMapAPITest.testConcurrentWritesAndIteration(BaseAtomicHashMapAPITest.java:254) ~[test-classes/:?]
...
	Caused by: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 100 milliseconds for key testConcurrentWritesAndIteration and requestor GlobalTx:NodeA-24638:41069. Lock is held by GlobalTx:NodeA-24638:41063
...
00:12:22,644 TRACE (remote-thread-NodeC-p44691-t5:[]) [DefaultLockManager] Release locks for keys=[testConcurrentWritesAndIteration]. owner=GlobalTx:NodeA-24638:41063
{noformat}

> APIDistTest random failures
> ---------------------------
>
>                 Key: ISPN-4772
>                 URL: https://issues.jboss.org/browse/ISPN-4772
>             Project: Infinispan
>          Issue Type: Bug
>          Components: Test Suite - Core
>    Affects Versions: 7.0.0.Beta2
>            Reporter: Dan Berindei
>            Assignee: Dan Berindei
>            Priority: Blocker
>              Labels: testsuite_stability
>             Fix For: 9.0.0.Alpha2
>
>
> The lock acquisition timeout is too small, because the asynchronous TxCompletionNotificationCommand can easily be delayed by more than 100ms.
> Failure in CI here: http://ci.infinispan.org/viewLog.html?buildId=12250&buildTypeId=bt8&tab=buildResultsDiv



--
This message was sent by Atlassian JIRA
(v7.2.3#72005)