[jboss-jira] [JBoss JIRA] (WFLY-12995) ISPN008027: SQL error while fetching stored entry
Tommasso Borgato (Jira)
issues at jboss.org
Mon Jan 20 04:07:14 EST 2020
[ https://issues.redhat.com/browse/WFLY-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tommasso Borgato updated WFLY-12995:
------------------------------------
Description:
This error was spotted in EAP Clustering tests where a relational MySQL Database is used to store replicated session data;
The error does not affects the overall fail rate that remains under the desired threshold;
Nevertheless the error was never observed in former tests and is hence considered worth reporting;
The error happened on node 2 of the 4 nodes cluster, twice:
- immediately after node 1 was failed (via EAP shutdown)
- immediately after node 3 was failed and then restored
The error log is the following:
{noformat}
2020-01-18 13:16:53,621 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,622 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,630 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,631 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t66) [Context=client-mappings] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
2020-01-18 13:16:53,665 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t65) [Context=cbnc.ear/clusterbench-ejb.jar/infinispan] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 19
2020-01-18 13:16:53,675 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,676 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=default-server] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
2020-01-18 13:16:53,677 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,679 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,682 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,697 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,720 ERROR [org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore] (InfinispanSessionManager - 1) ISPN008027: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
2020-01-18 13:16:53,723 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (InfinispanSessionManager - 1) ISPN000136: Error executing command GetKeyValueCommand on Cache 'cbnc.ear.a.war', writing keys []: org.infinispan.persistence.spi.PersistenceException: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:361)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
Caused by: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
... 64 more
2020-01-18 13:18:50,041 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,044 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,045 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,052 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,053 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
{noformat}
Find attached the complete logs and a report of the test phases;
Link to complete test run: [eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7#48|https://eap-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7/48/artifact/report/]
was:
This error was spotted in EAP Clustering tests where a relational MySQL Database is used to store replicated session data;
The error does not affects the overall fail rate that remains under the desired threshold;
Nevertheless the error was never observed in former tests and is hence considered a regression worth reporting;
The error happened on node 2 of the 4 nodes cluster, twice:
- immediately after node 1 was failed (via EAP shutdown)
- immediately after node 3 was failed and then restored
The error log is the following:
{noformat}
2020-01-18 13:16:53,621 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,622 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,630 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
2020-01-18 13:16:53,631 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t66) [Context=client-mappings] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
2020-01-18 13:16:53,665 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t65) [Context=cbnc.ear/clusterbench-ejb.jar/infinispan] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 19
2020-01-18 13:16:53,675 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,676 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=default-server] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
2020-01-18 13:16:53,677 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,679 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,682 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
2020-01-18 13:16:53,697 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
2020-01-18 13:16:53,720 ERROR [org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore] (InfinispanSessionManager - 1) ISPN008027: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
2020-01-18 13:16:53,723 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (InfinispanSessionManager - 1) ISPN000136: Error executing command GetKeyValueCommand on Cache 'cbnc.ear.a.war', writing keys []: org.infinispan.persistence.spi.PersistenceException: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:361)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
Caused by: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
... 64 more
2020-01-18 13:18:50,041 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,044 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,045 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
2020-01-18 13:18:50,052 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
2020-01-18 13:18:50,053 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
{noformat}
Find attached the complete logs and a report of the test phases;
Link to complete test run: [eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7#48|https://eap-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7/48/artifact/report/]
> ISPN008027: SQL error while fetching stored entry
> -------------------------------------------------
>
> Key: WFLY-12995
> URL: https://issues.redhat.com/browse/WFLY-12995
> Project: WildFly
> Issue Type: Bug
> Components: Clustering
> Affects Versions: 19.0.0.Beta2
> Reporter: Tommasso Borgato
> Assignee: Paul Ferraro
> Priority: Major
> Attachments: clustering.html, wlf_20200918-130906-wildfly-service-2-server.log
>
>
> This error was spotted in EAP Clustering tests where a relational MySQL Database is used to store replicated session data;
> The error does not affects the overall fail rate that remains under the desired threshold;
> Nevertheless the error was never observed in former tests and is hence considered worth reporting;
> The error happened on node 2 of the 4 nodes cluster, twice:
> - immediately after node 1 was failed (via EAP shutdown)
> - immediately after node 3 was failed and then restored
> The error log is the following:
> {noformat}
> 2020-01-18 13:16:53,621 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
> 2020-01-18 13:16:53,622 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
> 2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
> 2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
> 2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
> 2020-01-18 13:16:53,623 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
> 2020-01-18 13:16:53,630 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|4] (3) [wildfly2, wildfly3, wildfly4]
> 2020-01-18 13:16:53,631 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100001: Node wildfly1 left the cluster
> 2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
> 2020-01-18 13:16:53,664 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t66) [Context=client-mappings] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
> 2020-01-18 13:16:53,665 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p18-t65) [Context=cbnc.ear/clusterbench-ejb.jar/infinispan] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 19
> 2020-01-18 13:16:53,675 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.b.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
> 2020-01-18 13:16:53,676 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=default-server] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 15
> 2020-01-18 13:16:53,677 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
> 2020-01-18 13:16:53,679 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t1) [Context=cbnc.ear.c.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
> 2020-01-18 13:16:53,682 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100007: After merge (or coordinator change), recovered members [wildfly2, wildfly3, wildfly4] with topology id 8
> 2020-01-18 13:16:53,697 INFO [org.infinispan.CLUSTER] (stateTransferExecutor-thread--p20-t61) [Context=cbnc.ear.a.war] ISPN100008: Updating cache members list [wildfly2, wildfly3, wildfly4], topology id 9
> 2020-01-18 13:16:53,720 ERROR [org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore] (InfinispanSessionManager - 1) ISPN008027: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
> at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
> at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
> at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
> at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
> at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
> at java.base/java.lang.Thread.run(Thread.java:834)
> at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
> 2020-01-18 13:16:53,723 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (InfinispanSessionManager - 1) ISPN000136: Error executing command GetKeyValueCommand on Cache 'cbnc.ear.a.war', writing keys []: org.infinispan.persistence.spi.PersistenceException: SQL error while fetching stored entry with key: SessionAccessMetaDataKey(wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ), lockingKey: 6wfKG6Glx3bmXTmdyaQAiORrGTQ5s5uRCwP-X5UrZ
> at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:361)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.spi.SegmentedAdvancedLoadWriteStore.load(SegmentedAdvancedLoadWriteStore.java:46)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.loadFromAllStores(PersistenceManagerImpl.java:642)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndCheckExpiration(PersistenceUtil.java:139)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.lambda$loadAndComputeInDataContainer$0(PersistenceUtil.java:97)
> at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.lambda$compute$3(AbstractInternalDataContainer.java:231)
> at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1908)
> at org.infinispan at 9.4.17.Final//org.infinispan.container.impl.AbstractInternalDataContainer.compute(AbstractInternalDataContainer.java:230)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndComputeInDataContainer(PersistenceUtil.java:119)
> at org.infinispan at 9.4.17.Final//org.infinispan.persistence.internal.PersistenceUtil.loadAndStoreInDataContainer(PersistenceUtil.java:53)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadInContext(CacheLoaderInterceptor.java:333)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:328)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitDataCommand(CacheLoaderInterceptor.java:195)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:130)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitDataReadCommand(EntryWrappingInterceptor.java:204)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitGetKeyValueCommand(EntryWrappingInterceptor.java:192)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:61)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitGetKeyValueCommand(AbstractLockingInterceptor.java:107)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:54)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:318)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:183)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.handleReadCommand(BaseStateTransferInterceptor.java:193)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BaseStateTransferInterceptor.visitGetKeyValueCommand(BaseStateTransferInterceptor.java:168)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:123)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:69)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitGetKeyValueCommand(DDAsyncInterceptor.java:106)
> at org.infinispan at 9.4.17.Final//org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:39)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
> at org.infinispan at 9.4.17.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:527)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:520)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.EncoderCache.get(EncoderCache.java:660)
> at org.infinispan at 9.4.17.Final//org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:438)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.getValue(InfinispanSessionMetaDataFactory.java:100)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:88)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.findValue(InfinispanSessionMetaDataFactory.java:56)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:61)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.schedule(SessionExpirationScheduler.java:45)
> at org.wildfly.clustering.web.infinispan at 19.0.0.Beta2-SNAPSHOT//org.wildfly.clustering.web.infinispan.session.InfinispanSessionManagerFactory$ScheduleExpirationTask.run(InfinispanSessionManagerFactory.java:286)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
> at org.jboss.as.clustering.common at 19.0.0.Beta2-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
> at java.base/java.lang.Thread.run(Thread.java:834)
> at org.jboss.threads at 2.3.3.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
> Caused by: java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 2c2b4a37
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.tryLock(BaseWrapperManagedConnection.java:405)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedConnection.lock(WrappedConnection.java:165)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedStatement.lock(WrappedStatement.java:138)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.lock(WrappedResultSet.java:6022)
> at org.jboss.ironjacamar.jdbcadapters at 1.4.20.Final//org.jboss.jca.adapters.jdbc.WrappedResultSet.next(WrappedResultSet.java:2679)
> at org.infinispan.persistence.jdbc at 9.4.17.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.load(JdbcStringBasedStore.java:354)
> ... 64 more
> 2020-01-18 13:18:50,041 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
> 2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
> 2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
> 2020-01-18 13:18:50,043 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
> 2020-01-18 13:18:50,044 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
> 2020-01-18 13:18:50,045 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
> 2020-01-18 13:18:50,052 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN000094: Received new cluster view for channel ejb: [wildfly2|5] (4) [wildfly2, wildfly3, wildfly4, wildfly1]
> 2020-01-18 13:18:50,053 INFO [org.infinispan.CLUSTER] (thread-19,ejb,wildfly2) ISPN100000: Node wildfly1 joined the cluster
> {noformat}
> Find attached the complete logs and a report of the test phases;
> Link to complete test run: [eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7#48|https://eap-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/eap-7.x-clustering-db-session-shutdown-repl-mysql-5.7/48/artifact/report/]
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
More information about the jboss-jira
mailing list