[JBoss JIRA] (ISPN-8912) The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
by Andreas Pabst (JIRA)
[ https://issues.jboss.org/browse/ISPN-8912?page=com.atlassian.jira.plugin.... ]
Andreas Pabst commented on ISPN-8912:
-------------------------------------
The exception is one of the following:
ERROR: Error in indexer thread
java.lang.IllegalArgumentException: Offset=28851315, length=-32756
at org.infinispan.persistence.sifs.Index$Segment.freeIndexSpace(Index.java:473)
at org.infinispan.persistence.sifs.IndexNode.setPosition(IndexNode.java:382)
at org.infinispan.persistence.sifs.Index$Segment.run(Index.java:316)
or
Caused by: java.lang.IllegalArgumentException
at java.nio.ByteBuffer.allocate(ByteBuffer.java:334)
at org.infinispan.persistence.sifs.IndexNode.loadBuffer(IndexNode.java:100)
at org.infinispan.persistence.sifs.IndexNode.<init>(IndexNode.java:65)
at org.infinispan.persistence.sifs.IndexNode$InnerNode.getIndexNode(IndexNode.java:927)
at org.infinispan.persistence.sifs.IndexNode.applyOnLeaf(IndexNode.java:280)
at org.infinispan.persistence.sifs.Index.getRecord(Index.java:91)
at org.infinispan.persistence.sifs.SoftIndexFileStore.load(SoftIndexFileStore.java:407)
... 52 more
> The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: ISPN-8912
> URL: https://issues.jboss.org/browse/ISPN-8912
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 9.1.6.Final
> Reporter: Andreas Pabst
> Assignee: Tristan Tarrant
>
> The following unit test just puts lots of entries into the cache and restarts the cache repeatedly.
> It succeeds if maxNodeSize is set to anything up to 32777, but runs into a deadlock from 32778 upwards. If going even higher it doesn't run into a deadlock anymore, but throws an IllegalArgumentException instead.
> As a workaround one can delete the index. But the problem resurfaces after the next restart.
> {code:java}
> import java.util.concurrent.TimeUnit;
> import java.util.stream.IntStream;
> import org.infinispan.Cache;
> import org.infinispan.configuration.cache.Configuration;
> import org.infinispan.configuration.cache.ConfigurationBuilder;
> import org.infinispan.manager.DefaultCacheManager;
> import org.infinispan.manager.EmbeddedCacheManager;
> import org.infinispan.persistence.sifs.configuration.SoftIndexFileStoreConfigurationBuilder;
> import org.junit.After;
> import org.junit.Before;
> import org.junit.Rule;
> import org.junit.Test;
> import org.junit.rules.Timeout;
> public class SifsLargeNodeTest {
> private EmbeddedCacheManager cacheManager;
> @Rule
> public Timeout timeout = new Timeout(15, TimeUnit.SECONDS);
> private static Configuration createConfig(String location, int maxNodeSizeInBytes) {
> return new ConfigurationBuilder()
> .persistence().addStore(SoftIndexFileStoreConfigurationBuilder.class)
> .dataLocation(location + "/data").indexLocation(location + "/index")
> .maxNodeSize(maxNodeSizeInBytes)
> .preload(false).purgeOnStartup(false)
> .build();
> }
> @Before
> public void setUp() {
> cacheManager = new DefaultCacheManager();
> }
> @After
> public void tearDown() {
> cacheManager.stop();
> }
> @Test
> public void testLoad() {
> int maxNodeSizeInBytes = 32780; // Note: Anything up to 32777 works fine
> String cacheName = "sifslargenodetestcache";
> Configuration cfg = createConfig(cacheName, maxNodeSizeInBytes);
> int numberOfRuns = 10;
> int valuesToPutPerRun = 10000;
> for (int run = 0; run < numberOfRuns; run++) {
> System.out.println("RUN " + run);
> cacheManager.defineConfiguration(cacheName, cfg);
> Cache<Integer, String> testCacheBeforeReduction = cacheManager.getCache(cacheName);
> IntStream.range(run * valuesToPutPerRun, (run + 1) * valuesToPutPerRun)
> .forEach(i -> testCacheBeforeReduction.put(i, Integer.toString(i)));
> cacheManager.stop();
> cacheManager = new DefaultCacheManager();
> }
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8912) The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
by Tristan Tarrant (JIRA)
[ https://issues.jboss.org/browse/ISPN-8912?page=com.atlassian.jira.plugin.... ]
Tristan Tarrant reassigned ISPN-8912:
-------------------------------------
Assignee: Tristan Tarrant
> The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: ISPN-8912
> URL: https://issues.jboss.org/browse/ISPN-8912
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 9.1.6.Final
> Reporter: Andreas Pabst
> Assignee: Tristan Tarrant
>
> The following unit test just puts lots of entries into the cache and restarts the cache repeatedly.
> It succeeds if maxNodeSize is set to anything up to 32777, but runs into a deadlock from 32778 upwards. If going even higher it doesn't run into a deadlock anymore, but throws an IllegalArgumentException instead.
> As a workaround one can delete the index. But the problem resurfaces after the next restart.
> {code:java}
> import java.util.concurrent.TimeUnit;
> import java.util.stream.IntStream;
> import org.infinispan.Cache;
> import org.infinispan.configuration.cache.Configuration;
> import org.infinispan.configuration.cache.ConfigurationBuilder;
> import org.infinispan.manager.DefaultCacheManager;
> import org.infinispan.manager.EmbeddedCacheManager;
> import org.infinispan.persistence.sifs.configuration.SoftIndexFileStoreConfigurationBuilder;
> import org.junit.After;
> import org.junit.Before;
> import org.junit.Rule;
> import org.junit.Test;
> import org.junit.rules.Timeout;
> public class SifsLargeNodeTest {
> private EmbeddedCacheManager cacheManager;
> @Rule
> public Timeout timeout = new Timeout(15, TimeUnit.SECONDS);
> private static Configuration createConfig(String location, int maxNodeSizeInBytes) {
> return new ConfigurationBuilder()
> .persistence().addStore(SoftIndexFileStoreConfigurationBuilder.class)
> .dataLocation(location + "/data").indexLocation(location + "/index")
> .maxNodeSize(maxNodeSizeInBytes)
> .preload(false).purgeOnStartup(false)
> .build();
> }
> @Before
> public void setUp() {
> cacheManager = new DefaultCacheManager();
> }
> @After
> public void tearDown() {
> cacheManager.stop();
> }
> @Test
> public void testLoad() {
> int maxNodeSizeInBytes = 32780; // Note: Anything up to 32777 works fine
> String cacheName = "sifslargenodetestcache";
> Configuration cfg = createConfig(cacheName, maxNodeSizeInBytes);
> int numberOfRuns = 10;
> int valuesToPutPerRun = 10000;
> for (int run = 0; run < numberOfRuns; run++) {
> System.out.println("RUN " + run);
> cacheManager.defineConfiguration(cacheName, cfg);
> Cache<Integer, String> testCacheBeforeReduction = cacheManager.getCache(cacheName);
> IntStream.range(run * valuesToPutPerRun, (run + 1) * valuesToPutPerRun)
> .forEach(i -> testCacheBeforeReduction.put(i, Integer.toString(i)));
> cacheManager.stop();
> cacheManager = new DefaultCacheManager();
> }
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8893) Stack trace of a primary request of Infinispan is lost, damaging supportability severely
by Carlo de Wolf (JIRA)
[ https://issues.jboss.org/browse/ISPN-8893?page=com.atlassian.jira.plugin.... ]
Carlo de Wolf updated ISPN-8893:
--------------------------------
Summary: Stack trace of a primary request of Infinispan is lost, damaging supportability severely (was: [GSS](EAP 7.1.z) Stack trace of a primary request of Infinispan is lost, damaging supportability severely)
> Stack trace of a primary request of Infinispan is lost, damaging supportability severely
> ----------------------------------------------------------------------------------------
>
> Key: ISPN-8893
> URL: https://issues.jboss.org/browse/ISPN-8893
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Reporter: Yeray Borges
> Assignee: Yeray Borges
> Labels: top-50-list
>
> A request is handled by XNIO's "default task-NNN" thread. If the request executes a clustering cache operation, like session replication, it waits for the backup operation on another server. And if the other server failed on the backup operation, the primary server unwraps the exception to print only the remote exception. The original context of thread "default task-NNN" is lost and a user can't even identify what the primary operation was.
> This affects supportability too much. It seems only JDG 7.1 is free from this issue (it has {{AsyncInterceptorChain}}). All other releases like EAP 7.1, RHSSO which is based on EAP 7.0 has this issue.
> See the "Forum Reference" link of a mail thread for the detail.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8893) [GSS](EAP 7.1.z) Stack trace of a primary request of Infinispan is lost, damaging supportability severely
by Carlo de Wolf (JIRA)
[ https://issues.jboss.org/browse/ISPN-8893?page=com.atlassian.jira.plugin.... ]
Carlo de Wolf updated ISPN-8893:
--------------------------------
Summary: [GSS](EAP 7.1.z) Stack trace of a primary request of Infinispan is lost, damaging supportability severely (was: [GSS](7.1.z) Stack trace of a primary request of Infinispan is lost, damaging supportability severely)
> [GSS](EAP 7.1.z) Stack trace of a primary request of Infinispan is lost, damaging supportability severely
> ---------------------------------------------------------------------------------------------------------
>
> Key: ISPN-8893
> URL: https://issues.jboss.org/browse/ISPN-8893
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Reporter: Yeray Borges
> Assignee: Yeray Borges
> Labels: top-50-list
>
> A request is handled by XNIO's "default task-NNN" thread. If the request executes a clustering cache operation, like session replication, it waits for the backup operation on another server. And if the other server failed on the backup operation, the primary server unwraps the exception to print only the remote exception. The original context of thread "default task-NNN" is lost and a user can't even identify what the primary operation was.
> This affects supportability too much. It seems only JDG 7.1 is free from this issue (it has {{AsyncInterceptorChain}}). All other releases like EAP 7.1, RHSSO which is based on EAP 7.0 has this issue.
> See the "Forum Reference" link of a mail thread for the detail.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8912) The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
by Andreas Pabst (JIRA)
Andreas Pabst created ISPN-8912:
-----------------------------------
Summary: The SoftIndexFileStore runs into a deadlock at startup if more than ~20000 values have been stored and max node size is > 32777 bytes
Key: ISPN-8912
URL: https://issues.jboss.org/browse/ISPN-8912
Project: Infinispan
Issue Type: Bug
Components: Loaders and Stores
Affects Versions: 9.1.6.Final
Reporter: Andreas Pabst
The following unit test just puts lots of entries into the cache and restarts the cache repeatedly.
It succeeds if maxNodeSize is set to anything up to 32777, but runs into a deadlock from 32778 upwards. If going even higher it doesn't run into a deadlock anymore, but throws an IllegalArgumentException instead.
As a workaround one can delete the index. But the problem resurfaces after the next restart.
{code:java}
import java.util.concurrent.TimeUnit;
import java.util.stream.IntStream;
import org.infinispan.Cache;
import org.infinispan.configuration.cache.Configuration;
import org.infinispan.configuration.cache.ConfigurationBuilder;
import org.infinispan.manager.DefaultCacheManager;
import org.infinispan.manager.EmbeddedCacheManager;
import org.infinispan.persistence.sifs.configuration.SoftIndexFileStoreConfigurationBuilder;
import org.junit.After;
import org.junit.Before;
import org.junit.Rule;
import org.junit.Test;
import org.junit.rules.Timeout;
public class SifsLargeNodeTest {
private EmbeddedCacheManager cacheManager;
@Rule
public Timeout timeout = new Timeout(15, TimeUnit.SECONDS);
private static Configuration createConfig(String location, int maxNodeSizeInBytes) {
return new ConfigurationBuilder()
.persistence().addStore(SoftIndexFileStoreConfigurationBuilder.class)
.dataLocation(location + "/data").indexLocation(location + "/index")
.maxNodeSize(maxNodeSizeInBytes)
.preload(false).purgeOnStartup(false)
.build();
}
@Before
public void setUp() {
cacheManager = new DefaultCacheManager();
}
@After
public void tearDown() {
cacheManager.stop();
}
@Test
public void testLoad() {
int maxNodeSizeInBytes = 32780; // Note: Anything up to 32777 works fine
String cacheName = "sifslargenodetestcache";
Configuration cfg = createConfig(cacheName, maxNodeSizeInBytes);
int numberOfRuns = 10;
int valuesToPutPerRun = 10000;
for (int run = 0; run < numberOfRuns; run++) {
System.out.println("RUN " + run);
cacheManager.defineConfiguration(cacheName, cfg);
Cache<Integer, String> testCacheBeforeReduction = cacheManager.getCache(cacheName);
IntStream.range(run * valuesToPutPerRun, (run + 1) * valuesToPutPerRun)
.forEach(i -> testCacheBeforeReduction.put(i, Integer.toString(i)));
cacheManager.stop();
cacheManager = new DefaultCacheManager();
}
}
}
{code}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8910) CompatModeClusteredCacheTest.testMerge test failure
by Gustavo Fernandes (JIRA)
[ https://issues.jboss.org/browse/ISPN-8910?page=com.atlassian.jira.plugin.... ]
Gustavo Fernandes updated ISPN-8910:
------------------------------------
Status: Open (was: New)
> CompatModeClusteredCacheTest.testMerge test failure
> ---------------------------------------------------
>
> Key: ISPN-8910
> URL: https://issues.jboss.org/browse/ISPN-8910
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Query
> Affects Versions: 9.2.0.Final
> Reporter: Gustavo Fernandes
> Assignee: Gustavo Fernandes
>
> {noformat}
> Caused by: org.infinispan.util.UserRaisedFunctionalException: java.lang.ClassCastException: [B cannot be cast to org.infinispan.query.test.Person
> at org.infinispan.commands.functional.functions.MergeFunction.apply(MergeFunction.java:44)
> at org.infinispan.commands.functional.functions.MergeFunction.apply(MergeFunction.java:19)
> at org.infinispan.commands.functional.ReadWriteKeyCommand.perform(ReadWriteKeyCommand.java:100)
> at org.infinispan.interceptors.impl.CallInterceptor.visitCommand(CallInterceptor.java:29)
> at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
> at org.infinispan.interceptors.distribution.BaseDistributionInterceptor.handleNonTxWriteCommand(BaseDistributionInterceptor.java:260)
> at org.infinispan.interceptors.distribution.NonTxDistributionInterceptor.visitReadWriteKeyCommand(NonTxDistributionInterceptor.java:137)
> at org.infinispan.commands.functional.ReadWriteKeyCommand.acceptVisitor(ReadWriteKeyCommand.java:110)
> at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
> at org.infinispan.query.backend.QueryInterceptor.handleDataWriteCommand(QueryInterceptor.java:177)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8910) CompatModeClusteredCacheTest.testMerge test failure
by Gustavo Fernandes (JIRA)
[ https://issues.jboss.org/browse/ISPN-8910?page=com.atlassian.jira.plugin.... ]
Work on ISPN-8910 started by Gustavo Fernandes.
-----------------------------------------------
> CompatModeClusteredCacheTest.testMerge test failure
> ---------------------------------------------------
>
> Key: ISPN-8910
> URL: https://issues.jboss.org/browse/ISPN-8910
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Query
> Affects Versions: 9.2.0.Final
> Reporter: Gustavo Fernandes
> Assignee: Gustavo Fernandes
>
> {noformat}
> Caused by: org.infinispan.util.UserRaisedFunctionalException: java.lang.ClassCastException: [B cannot be cast to org.infinispan.query.test.Person
> at org.infinispan.commands.functional.functions.MergeFunction.apply(MergeFunction.java:44)
> at org.infinispan.commands.functional.functions.MergeFunction.apply(MergeFunction.java:19)
> at org.infinispan.commands.functional.ReadWriteKeyCommand.perform(ReadWriteKeyCommand.java:100)
> at org.infinispan.interceptors.impl.CallInterceptor.visitCommand(CallInterceptor.java:29)
> at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:56)
> at org.infinispan.interceptors.distribution.BaseDistributionInterceptor.handleNonTxWriteCommand(BaseDistributionInterceptor.java:260)
> at org.infinispan.interceptors.distribution.NonTxDistributionInterceptor.visitReadWriteKeyCommand(NonTxDistributionInterceptor.java:137)
> at org.infinispan.commands.functional.ReadWriteKeyCommand.acceptVisitor(ReadWriteKeyCommand.java:110)
> at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:98)
> at org.infinispan.query.backend.QueryInterceptor.handleDataWriteCommand(QueryInterceptor.java:177)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8911) Infinispan Server distribution contains redundant /dependencies directory (brings in additional 120 MB)
by Radoslav Husar (JIRA)
Radoslav Husar created ISPN-8911:
------------------------------------
Summary: Infinispan Server distribution contains redundant /dependencies directory (brings in additional 120 MB)
Key: ISPN-8911
URL: https://issues.jboss.org/browse/ISPN-8911
Project: Infinispan
Issue Type: Bug
Components: Build
Reporter: Radoslav Husar
Priority: Blocker
[rhusar@syrah infinispan-server-9.2.0.Final]$ ll
total 920
-rw-r--r--@ 1 rhusar staff 26530 Feb 28 21:42 LICENSE.txt
-rw-r--r--@ 1 rhusar staff 2612 Feb 28 21:42 README.txt
drwxr-xr-x@ 46 rhusar staff 1472 Feb 28 21:42 bin
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:42 client
-rw-r--r--@ 1 rhusar staff 2451 Feb 28 21:42 copyright.txt
*drwxr-xr-x@ 436 rhusar staff 13952 Feb 28 21:42 dependency*
drwxr-xr-x@ 6 rhusar staff 192 Feb 21 19:12 docs
drwxr-xr-x@ 5 rhusar staff 160 Feb 28 21:42 domain
*-rw-r--r--@ 1 rhusar staff 3333 Feb 28 21:30 infinispan-server-licenses-9.2.0.Final-tests.jar*
-rw-r--r--@ 1 rhusar staff 403683 Feb 28 21:42 jboss-modules.jar
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:30 maven-archiver
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:42 modules
drwxr-xr-x@ 8 rhusar staff 256 Feb 28 21:42 rest
-rw-r--r--@ 1 rhusar staff 21075 Feb 28 21:42 runtime-classpath.txt
drwxr-xr-x@ 6 rhusar staff 192 Feb 28 21:42 standalone
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months
[JBoss JIRA] (ISPN-8911) Infinispan Server distribution contains redundant /dependencies directory (brings in additional 120 MB)
by Radoslav Husar (JIRA)
[ https://issues.jboss.org/browse/ISPN-8911?page=com.atlassian.jira.plugin.... ]
Radoslav Husar updated ISPN-8911:
---------------------------------
Description:
[rhusar@syrah infinispan-server-9.2.0.Final]$ du -hcs dependency/
162M dependency/
162M total
was:
[rhusar@syrah infinispan-server-9.2.0.Final]$ ll
total 920
-rw-r--r--@ 1 rhusar staff 26530 Feb 28 21:42 LICENSE.txt
-rw-r--r--@ 1 rhusar staff 2612 Feb 28 21:42 README.txt
drwxr-xr-x@ 46 rhusar staff 1472 Feb 28 21:42 bin
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:42 client
-rw-r--r--@ 1 rhusar staff 2451 Feb 28 21:42 copyright.txt
*drwxr-xr-x@ 436 rhusar staff 13952 Feb 28 21:42 dependency*
drwxr-xr-x@ 6 rhusar staff 192 Feb 21 19:12 docs
drwxr-xr-x@ 5 rhusar staff 160 Feb 28 21:42 domain
*-rw-r--r--@ 1 rhusar staff 3333 Feb 28 21:30 infinispan-server-licenses-9.2.0.Final-tests.jar*
-rw-r--r--@ 1 rhusar staff 403683 Feb 28 21:42 jboss-modules.jar
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:30 maven-archiver
drwxr-xr-x@ 3 rhusar staff 96 Feb 28 21:42 modules
drwxr-xr-x@ 8 rhusar staff 256 Feb 28 21:42 rest
-rw-r--r--@ 1 rhusar staff 21075 Feb 28 21:42 runtime-classpath.txt
drwxr-xr-x@ 6 rhusar staff 192 Feb 28 21:42 standalone
> Infinispan Server distribution contains redundant /dependencies directory (brings in additional 120 MB)
> -------------------------------------------------------------------------------------------------------
>
> Key: ISPN-8911
> URL: https://issues.jboss.org/browse/ISPN-8911
> Project: Infinispan
> Issue Type: Bug
> Components: Build
> Affects Versions: 9.2.0.Final
> Reporter: Radoslav Husar
> Priority: Blocker
>
> [rhusar@syrah infinispan-server-9.2.0.Final]$ du -hcs dependency/
> 162M dependency/
> 162M total
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
6 years, 2 months