[JBoss JIRA] (ISPN-5834) LockObtainFailedException thrown in query testsuite
by Gustavo Fernandes (JIRA)
[ https://issues.jboss.org/browse/ISPN-5834?page=com.atlassian.jira.plugin.... ]
Gustavo Fernandes updated ISPN-5834:
------------------------------------
Status: Pull Request Sent (was: Coding In Progress)
Git Pull Request: https://github.com/infinispan/infinispan/pull/3741
> LockObtainFailedException thrown in query testsuite
> ---------------------------------------------------
>
> Key: ISPN-5834
> URL: https://issues.jboss.org/browse/ISPN-5834
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Query
> Affects Versions: 8.1.0.Alpha1
> Reporter: Gustavo Fernandes
> Assignee: Gustavo Fernandes
> Fix For: 8.1.0.CR1
>
>
> Happening on {{IndexCacheStopTest#testIndexingMultipleDirectoriesOnSameCache}} apparently since migration to Lucene 5
> {code}
> 3218 [ERROR] LogErrorHandler: HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: lock instance already assigned
> Primary Failure:
> Entity org.infinispan.query.test.Person Id I:0 Work Type org.hibernate.search.backend.UpdateLuceneWork
> org.apache.lucene.store.LockObtainFailedException: lock instance already assigned
> at org.infinispan.lucene.impl.CommonLockObtainUtils.failLockAcquire(CommonLockObtainUtils.java:33) ~[classes/:?]
> at org.infinispan.lucene.impl.CommonLockObtainUtils.attemptObtain(CommonLockObtainUtils.java:20) ~[classes/:?]
> at org.infinispan.lucene.impl.BaseLockFactory.obtainLock(BaseLockFactory.java:34) ~[classes/:?]
> at org.infinispan.lucene.impl.BaseLockFactory.obtainLock(BaseLockFactory.java:18) ~[classes/:?]
> at org.infinispan.lucene.impl.DirectoryLucene.obtainLock(DirectoryLucene.java:145) ~[classes/:?]
> at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) ~[lucene-core-5.3.0.jar:5.3.0 1696229 - noble - 2015-08-17 16:59:03]
> at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-5834) LockObtainFailedException thrown in query testsuite
by Gustavo Fernandes (JIRA)
Gustavo Fernandes created ISPN-5834:
---------------------------------------
Summary: LockObtainFailedException thrown in query testsuite
Key: ISPN-5834
URL: https://issues.jboss.org/browse/ISPN-5834
Project: Infinispan
Issue Type: Bug
Components: Test Suite - Query
Affects Versions: 8.1.0.Alpha1
Reporter: Gustavo Fernandes
Assignee: Gustavo Fernandes
Fix For: 8.1.0.CR1
Happening on {{IndexCacheStopTest#testIndexingMultipleDirectoriesOnSameCache}} apparently since migration to Lucene 5
{code}
3218 [ERROR] LogErrorHandler: HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: lock instance already assigned
Primary Failure:
Entity org.infinispan.query.test.Person Id I:0 Work Type org.hibernate.search.backend.UpdateLuceneWork
org.apache.lucene.store.LockObtainFailedException: lock instance already assigned
at org.infinispan.lucene.impl.CommonLockObtainUtils.failLockAcquire(CommonLockObtainUtils.java:33) ~[classes/:?]
at org.infinispan.lucene.impl.CommonLockObtainUtils.attemptObtain(CommonLockObtainUtils.java:20) ~[classes/:?]
at org.infinispan.lucene.impl.BaseLockFactory.obtainLock(BaseLockFactory.java:34) ~[classes/:?]
at org.infinispan.lucene.impl.BaseLockFactory.obtainLock(BaseLockFactory.java:18) ~[classes/:?]
at org.infinispan.lucene.impl.DirectoryLucene.obtainLock(DirectoryLucene.java:145) ~[classes/:?]
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) ~[lucene-core-5.3.0.jar:5.3.0 1696229 - noble - 2015-08-17 16:59:03]
at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.0.Final.jar:5.5.0.Final]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
{code}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-4887) Stale locks in non-tx cache after merge
by Vladimir Dzhuvinov (JIRA)
[ https://issues.jboss.org/browse/ISPN-4887?page=com.atlassian.jira.plugin.... ]
Vladimir Dzhuvinov edited comment on ISPN-4887 at 10/6/15 2:11 PM:
-------------------------------------------------------------------
We have observed the same exception in logs of a server using Infinispan 7.2.3 in non-tx replicated cluster:
{{ISPN000136: Execution error
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23052,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) [infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
ISPN000071: Caught exception when handling command SingleRpcCommand{cacheName='sessionStore.sessionMap', command=ReplaceCommand{key=I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk, oldValue=null, newValue={"creation_time":1443662394,"sub":"CN-1G56N6E251W11","max_idle":120,"data":{"client_sessions":[{"client_id":"IX-1FXURP1U93W11"}]},"auth_time":1443662394,"amr":["ldap"],"max_life":20160,"auth_life":10080}, metadata=EmbeddedMetadata{version=null}, flags=null, successful=true, valueMatcher=MATCH_NON_NULL}}
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23069,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) ~[infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_60]}}
}}
was (Author: vdzhuvinov):
We have observed the same exception in logs of a server using Infinispan 7.2.3 in non-tx replicated cluster:
{{ISPN000136: Execution error
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23052,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) [infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
ISPN000071: Caught exception when handling command SingleRpcCommand{cacheName='sessionStore.sessionMap', command=ReplaceCommand{key=I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk, oldValue=null, newValue={"creation_time":1443662394,"sub":"CN-1G56N6E251W11","max_idle":120,"data":{"client_sessions":[{"client_id":"IX-1FXURP1U93W11"}]},"auth_time":1443662394,"amr":["ldap"],"max_life":20160,"auth_life":10080}, metadata=EmbeddedMetadata{version=null}, flags=null, successful=true, valueMatcher=MATCH_NON_NULL}}
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23069,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) ~[infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_60]
}}
> Stale locks in non-tx cache after merge
> ---------------------------------------
>
> Key: ISPN-4887
> URL: https://issues.jboss.org/browse/ISPN-4887
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 7.0.0.CR2
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Blocker
> Labels: testsuite_stability
>
> It appears to cause random failures in {{ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge0}}:
> {noformat}
> org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key MagicKey#null{74043ff7@ThreeNodesReplicatedSplitAndMergeTest-NodeC-12710/9} and requestor Thread[testng-ThreeNodesReplicatedSplitAndMergeTest,5,main]. Lock is held by Thread[remote-thread-ThreeNodesReplicatedSplitAndMergeTest-NodeC-p5654-t5,5,main], while request came from null
> at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198)
> at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:127)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:123)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitPutKeyValueCommand(AbstractLockingInterceptor.java:47)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:172)
> at org.infinispan.statetransfer.StateTransferInterceptor.visitPutKeyValueCommand(StateTransferInterceptor.java:95)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:148)
> at org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:134)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.partionhandling.impl.PartitionHandlingInterceptor.visitPutKeyValueCommand(PartitionHandlingInterceptor.java:34)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102)
> at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333)
> at org.infinispan.cache.impl.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1512)
> at org.infinispan.cache.impl.CacheImpl.putInternal(CacheImpl.java:990)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:982)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1582)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:235)
> at org.infinispan.partitionhandling.ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge(ThreeNodesReplicatedSplitAndMergeTest.java:132)
> at org.infinispan.partitionhandling.ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge0(ThreeNodesReplicatedSplitAndMergeTest.java:27)
> {noformat}
> http://ci.infinispan.org/viewLog.html?buildId=13499&tab=buildResultsDiv&b...
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-4887) Stale locks in non-tx cache after merge
by Vladimir Dzhuvinov (JIRA)
[ https://issues.jboss.org/browse/ISPN-4887?page=com.atlassian.jira.plugin.... ]
Vladimir Dzhuvinov commented on ISPN-4887:
------------------------------------------
We have observed the same exception in logs of a server using Infinispan 7.2.3 in non-tx replicated cluster:
{{ISPN000136: Execution error
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23052,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) [infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) [infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
ISPN000071: Caught exception when handling command SingleRpcCommand{cacheName='sessionStore.sessionMap', command=ReplaceCommand{key=I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk, oldValue=null, newValue={"creation_time":1443662394,"sub":"CN-1G56N6E251W11","max_idle":120,"data":{"client_sessions":[{"client_id":"IX-1FXURP1U93W11"}]},"auth_time":1443662394,"amr":["ldap"],"max_life":20160,"auth_life":10080}, metadata=EmbeddedMetadata{version=null}, flags=null, successful=true, valueMatcher=MATCH_NON_NULL}}
org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key I9AIaoAPU1N_HqvOeamQ-YZg9qHvo-K2vP6Ksq6t6Yk and requestor Thread[remote-thread--p3-t23069,5,main]. Lock is held by Thread[remote-thread--p3-t23108,5,main], while request came from stage-auth-app02-2214
at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:166) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:162) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:87) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:40) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitReplaceCommand(AbstractLockingInterceptor.java:60) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:311) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:249) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.statetransfer.StateTransferInterceptor.visitReplaceCommand(StateTransferInterceptor.java:128) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.CacheMgmtInterceptor.visitReplaceCommand(CacheMgmtInterceptor.java:182) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.AbstractVisitor.visitReplaceCommand(AbstractVisitor.java:54) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.write.ReplaceCommand.acceptVisitor(ReplaceCommand.java:55) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:336) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.BaseRpcInvokingCommand.processVisitableCommand(BaseRpcInvokingCommand.java:39) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.commands.remote.SingleRpcCommand.perform(SingleRpcCommand.java:48) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.invokePerform(BasePerCacheInboundInvocationHandler.java:85) ~[infinispan-embedded-7.2.3.Final.jar:na]
at org.infinispan.remoting.inboundhandler.BaseBlockingRunnable.run(BaseBlockingRunnable.java:32) ~[infinispan-embedded-7.2.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_60]
}}
> Stale locks in non-tx cache after merge
> ---------------------------------------
>
> Key: ISPN-4887
> URL: https://issues.jboss.org/browse/ISPN-4887
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 7.0.0.CR2
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Blocker
> Labels: testsuite_stability
>
> It appears to cause random failures in {{ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge0}}:
> {noformat}
> org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 10 seconds for key MagicKey#null{74043ff7@ThreeNodesReplicatedSplitAndMergeTest-NodeC-12710/9} and requestor Thread[testng-ThreeNodesReplicatedSplitAndMergeTest,5,main]. Lock is held by Thread[remote-thread-ThreeNodesReplicatedSplitAndMergeTest-NodeC-p5654-t5,5,main], while request came from null
> at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198)
> at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLockNoCheck(LockManagerImpl.java:181)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:127)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockKey(AbstractLockingInterceptor.java:123)
> at org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitPutKeyValueCommand(AbstractLockingInterceptor.java:47)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.statetransfer.StateTransferInterceptor.handleNonTxWriteCommand(StateTransferInterceptor.java:172)
> at org.infinispan.statetransfer.StateTransferInterceptor.visitPutKeyValueCommand(StateTransferInterceptor.java:95)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:148)
> at org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:134)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.partionhandling.impl.PartitionHandlingInterceptor.visitPutKeyValueCommand(PartitionHandlingInterceptor.java:34)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)
> at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102)
> at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71)
> at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:33)
> at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)
> at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333)
> at org.infinispan.cache.impl.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1512)
> at org.infinispan.cache.impl.CacheImpl.putInternal(CacheImpl.java:990)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:982)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1582)
> at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:235)
> at org.infinispan.partitionhandling.ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge(ThreeNodesReplicatedSplitAndMergeTest.java:132)
> at org.infinispan.partitionhandling.ThreeNodesReplicatedSplitAndMergeTest.testSplitAndMerge0(ThreeNodesReplicatedSplitAndMergeTest.java:27)
> {noformat}
> http://ci.infinispan.org/viewLog.html?buildId=13499&tab=buildResultsDiv&b...
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-1835) ModuleCommandFactory hierachy should be cleaned up
by Sanne Grinovero (JIRA)
[ https://issues.jboss.org/browse/ISPN-1835?page=com.atlassian.jira.plugin.... ]
Sanne Grinovero commented on ISPN-1835:
---------------------------------------
Is this out of date?
> ModuleCommandFactory hierachy should be cleaned up
> --------------------------------------------------
>
> Key: ISPN-1835
> URL: https://issues.jboss.org/browse/ISPN-1835
> Project: Infinispan
> Issue Type: Enhancement
> Components: Core
> Reporter: Galder Zamarreño
>
> The distinction between ModuleCommandFactory and ExtendedModuleCommandFactory should go away, and they should be independent interfaces.
> The reason for this is cos ModuleCommandFactory is a global component and so should care about creating global commands, i.e. perform GC.
> On the other hand ExtendedModuleCommandFactory (which should be renamed) is a cache component and so cares about creating cache specific global components, i.e. invalidate a named region (or cache) in 2LC.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-5832) Log relevant events through event logger
by Pedro Zapata (JIRA)
Pedro Zapata created ISPN-5832:
----------------------------------
Summary: Log relevant events through event logger
Key: ISPN-5832
URL: https://issues.jboss.org/browse/ISPN-5832
Project: Infinispan
Issue Type: Feature Request
Reporter: Pedro Zapata
By using the event logger, make sure the different subsystems log the relevant events:
* Task execution (as requested by users)
* Node join/leave
* Split/Merge
* Rebalancing start / stop
* Mass indexer
* Server start/shutdown
* Site up / down
* Cache related events
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months
[JBoss JIRA] (ISPN-5830) Manage state transfer actions
by Pedro Zapata (JIRA)
[ https://issues.jboss.org/browse/ISPN-5830?page=com.atlassian.jira.plugin.... ]
Pedro Zapata updated ISPN-5830:
-------------------------------
Labels: jdg7 (was: )
> Manage state transfer actions
> -----------------------------
>
> Key: ISPN-5830
> URL: https://issues.jboss.org/browse/ISPN-5830
> Project: Infinispan
> Issue Type: Sub-task
> Components: Console
> Reporter: Pedro Zapata
> Labels: jdg7
>
> As an administrator, I want to control Cross site state transfer (when replica sites go offline and come back online) conveniently from the Management Console.
> At its core, this is a cache level operation. However, we need a Cache container level operation that will transfer state for all cache that are replicated to the affected data-center(s).
> The following actions will be added to the Cache container action menu
> - Take site offline
> - Bring site online
> Another 2 additional options will also be added:
> - Force state transfer
> - Stop state transfer
> Those options will be only enabled if cross site replication is enabled
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 3 months