[infinispan-issues] [JBoss JIRA] Created: (ISPN-1329) org.infinispan.loaders.decorators.AsyncStore leads to OutOfMemoryExceptions

[Robert Stupp (JIRA)]

org.infinispan.loaders.decorators.AsyncStore leads to OutOfMemoryExceptions
---------------------------------------------------------------------------

                 Key: ISPN-1329
                 URL: https://issues.jboss.org/browse/ISPN-1329
             Project: Infinispan
          Issue Type: Bug
          Components: Configuration, Loaders and Stores
    Affects Versions: 5.0.0.CR8
            Reporter: Robert Stupp
            Assignee: Manik Surtani


When I configure
{code} 
<async
    enabled="true"
    threadPoolSize="3"/>
{code}
the implementation creates three threads names "CoalescedAsyncStore" per cache store.

When adding a large amount of data to the cache (for example indexing a lot of Lucene documents), the application will stop working with a lot of OutOfMemory exceptions.

This is caused by the implementation of org.infinispan.loaders.decorators.AsyncStore that uses an unbounded LinkedBlockingQueue.
A lot of worker threads push a huge amount of modifications into the queues, but the underlying cache store is not able to handle throughput.

As a quick solution change
{code}
   private final LinkedBlockingQueue<Modification> changesDeque = new LinkedBlockingQueue<Modification>();
{code}
to
{code}
   private final LinkedBlockingQueue<Modification> changesDeque = new LinkedBlockingQueue<Modification>(512);
{code}

and add a new configuration option to the async element, that specifies the capacity of the Linked Blocking Queue.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira