[Red Hat JIRA] (ISPN-12425) Inifinispan + JDBC cachestore runs statistic collection on Oracle DB
by Evgenii Balakhonov (Jira)
Evgenii Balakhonov created ISPN-12425:
-----------------------------------------
Summary: Inifinispan + JDBC cachestore runs statistic collection on Oracle DB
Key: ISPN-12425
URL: https://issues.redhat.com/browse/ISPN-12425
Project: Infinispan
Issue Type: Bug
Components: Loaders and Stores
Affects Versions: 11.0.4.Final
Reporter: Evgenii Balakhonov
In class OracleTableManager at string 61 there is:
rs = meta.getIndexInfo(null, null, tableName.toString(), false, {color:#FF0000}*false*{color});
last parameter is *approximate* (when true, result is allowed to reflect approximate or out of data values; when false, results are requested to be accurate)
When Oracle DB used for JDBC cachestore and this parameter == false, then during startup Infinispan runs statistic gathering for every cache table. As a result it spends a lot of time during startup.
I think that parameter "approximate" must be changed to true:
rs = meta.getIndexInfo(null, null, tableName.toString(), false, *true*);
in this case Oracle uses existing metainformation of the table.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 6 months
[Red Hat JIRA] (ISPN-12423) Infispan thread freezing (STUCK) - dead lock occured
by Will Burns (Jira)
[ https://issues.redhat.com/browse/ISPN-12423?page=com.atlassian.jira.plugi... ]
Will Burns commented on ISPN-12423:
-----------------------------------
[~c0ff75] Are you certain it doesn't make any progress?
> Infispan thread freezing (STUCK) - dead lock occured
> ----------------------------------------------------
>
> Key: ISPN-12423
> URL: https://issues.redhat.com/browse/ISPN-12423
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 11.0.4.Final
> Reporter: Evgenii Balakhonov
> Priority: Major
> Attachments: Thread dump - heap storage.txt, Thread dump sync.txt, Thread dump.txt, cache-configuration-jdbc.xml
>
>
> During huge load some threads hangs on
> java.lang.Thread.State: WAITING (parking)
> java.lang.Thread.State: WAITING (parking)
> at sun.misc.Unsafe.park(Native Method)
> - parking to wait for <0x00000005d2e654a8> (a java.util.concurrent.locks.StampedLock)
> at java.util.concurrent.locks.StampedLock.acquireRead(StampedLock.java:1215)
> at java.util.concurrent.locks.StampedLock.readLock(StampedLock.java:428)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peekOrGet(OffHeapConcurrentMap.java:615)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peek(OffHeapConcurrentMap.java:682)
> I attached Infinispan configuration and three thread dumps:
> * off heap storage enabled (Thread dump.txt)
> * heap storage enabled (Thread dump - heap storage.txt)
> * off heap storage enabled and replicated cache mode="SYNC" (thread dump sync.txt)
> Under high load, Infinspan freezes 100% of the cases.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 6 months
[Red Hat JIRA] (ISPN-12423) Infispan thread freezing (STUCK) - dead lock occured
by Will Burns (Jira)
[ https://issues.redhat.com/browse/ISPN-12423?page=com.atlassian.jira.plugi... ]
Will Burns commented on ISPN-12423:
-----------------------------------
From the off heap stack traces it appears that it boils down to some threads blocking waiting on the lruLock which is present for the given data container when eviction is enabled.
However, I couldn't find any thread that would actually be holding the lock and a glance at the source for 11.0.4 all references to the lock have the same try finally unlock idiom which means it should always be unlocked.
Looking at the on heap one and it seems to be a similar issue that there is no thread holding the lock and just a bunch waiting for it, note our on heap implementation is using Caffeine, which I would be surprised if they had an issue with their locks as well.
I can try to glance again tomorrow with fresh eyes though :)
> Infispan thread freezing (STUCK) - dead lock occured
> ----------------------------------------------------
>
> Key: ISPN-12423
> URL: https://issues.redhat.com/browse/ISPN-12423
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 11.0.4.Final
> Reporter: Evgenii Balakhonov
> Priority: Major
> Attachments: Thread dump - heap storage.txt, Thread dump sync.txt, Thread dump.txt, cache-configuration-jdbc.xml
>
>
> During huge load some threads hangs on
> java.lang.Thread.State: WAITING (parking)
> java.lang.Thread.State: WAITING (parking)
> at sun.misc.Unsafe.park(Native Method)
> - parking to wait for <0x00000005d2e654a8> (a java.util.concurrent.locks.StampedLock)
> at java.util.concurrent.locks.StampedLock.acquireRead(StampedLock.java:1215)
> at java.util.concurrent.locks.StampedLock.readLock(StampedLock.java:428)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peekOrGet(OffHeapConcurrentMap.java:615)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peek(OffHeapConcurrentMap.java:682)
> I attached Infinispan configuration and three thread dumps:
> * off heap storage enabled (Thread dump.txt)
> * heap storage enabled (Thread dump - heap storage.txt)
> * off heap storage enabled and replicated cache mode="SYNC" (thread dump sync.txt)
> Under high load, Infinspan freezes 100% of the cases.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 6 months
[Red Hat JIRA] (ISPN-12423) Infispan thread freezing (STUCK) - dead lock occured
by Evgenii Balakhonov (Jira)
[ https://issues.redhat.com/browse/ISPN-12423?page=com.atlassian.jira.plugi... ]
Evgenii Balakhonov updated ISPN-12423:
--------------------------------------
Description:
During huge load some threads hangs on
java.lang.Thread.State: WAITING (parking)
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005d2e654a8> (a java.util.concurrent.locks.StampedLock)
at java.util.concurrent.locks.StampedLock.acquireRead(StampedLock.java:1215)
at java.util.concurrent.locks.StampedLock.readLock(StampedLock.java:428)
at org.infinispan.container.offheap.OffHeapConcurrentMap.peekOrGet(OffHeapConcurrentMap.java:615)
at org.infinispan.container.offheap.OffHeapConcurrentMap.peek(OffHeapConcurrentMap.java:682)
I attached Infinispan configuration and three thread dumps:
* off heap storage enabled (Thread dump.txt)
* heap storage enabled (Thread dump - heap storage.txt)
* off heap storage enabled and replicated cache mode="SYNC" (thread dump sync.txt)
Under high load, Infinspan freezes 100% of the cases.
was:
During huge load some threads hangs on
java.lang.Thread.State: WAITING (parking)
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005d2e654a8> (a java.util.concurrent.locks.StampedLock)
at java.util.concurrent.locks.StampedLock.acquireRead(StampedLock.java:1215)
at java.util.concurrent.locks.StampedLock.readLock(StampedLock.java:428)
at org.infinispan.container.offheap.OffHeapConcurrentMap.peekOrGet(OffHeapConcurrentMap.java:615)
at org.infinispan.container.offheap.OffHeapConcurrentMap.peek(OffHeapConcurrentMap.java:682)
I attached Infinispan configuration and three thread dumps:
* off heap storage enabled (Thread dump.txt)
* heap storage enabled (Thread dump - heap storage.txt)
* heap storage enabled and replicated cache mode="SYNC" (thread dump sync.txt)
Under high load, Infinspan freezes 100% of the cases.
> Infispan thread freezing (STUCK) - dead lock occured
> ----------------------------------------------------
>
> Key: ISPN-12423
> URL: https://issues.redhat.com/browse/ISPN-12423
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 11.0.4.Final
> Reporter: Evgenii Balakhonov
> Priority: Major
> Attachments: Thread dump - heap storage.txt, Thread dump sync.txt, Thread dump.txt, cache-configuration-jdbc.xml
>
>
> During huge load some threads hangs on
> java.lang.Thread.State: WAITING (parking)
> java.lang.Thread.State: WAITING (parking)
> at sun.misc.Unsafe.park(Native Method)
> - parking to wait for <0x00000005d2e654a8> (a java.util.concurrent.locks.StampedLock)
> at java.util.concurrent.locks.StampedLock.acquireRead(StampedLock.java:1215)
> at java.util.concurrent.locks.StampedLock.readLock(StampedLock.java:428)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peekOrGet(OffHeapConcurrentMap.java:615)
> at org.infinispan.container.offheap.OffHeapConcurrentMap.peek(OffHeapConcurrentMap.java:682)
> I attached Infinispan configuration and three thread dumps:
> * off heap storage enabled (Thread dump.txt)
> * heap storage enabled (Thread dump - heap storage.txt)
> * off heap storage enabled and replicated cache mode="SYNC" (thread dump sync.txt)
> Under high load, Infinspan freezes 100% of the cases.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 6 months