[infinispan-dev] Infinispan Memory Issue - Storing Index Memory(ram) - OutOfMemoryError: Java heap space

Sridhar Jena sjena at aurusinc.com
Tue Jan 10 11:06:18 EST 2017


Hi Dev Team,

I am using infinispan 8.2.4 standalone hotrod server and i am facing 
"*java.lang.OutOfMemoryError: Java heap space*"  issue when putting or 
retrieving the data into cache.

In below two ways i have loaded the data into local cache.

_/*Case 1*/_ : *(Data Loading is taking more time, But there is no issue 
with **"**OutOfMemoryError: Java heap space**"**)*

In this case I am storing the index into a different dedicated 
infinispan cache by using the below tag ,

/*<property name="default.directory_provider">Infinispan</property>*/

I have observed that it is taking much time to load the data into cache 
, but in this case i am not facing /Java Out of memory heap space/ issue 
during data putting or retrieving.

/Below is local cache configuration,/

<local-cache name="MERCHANT_STORE_DETAILS" start="EAGER">

             <locking acquire-timeout="30000" concurrency-level="1000" 
striping="false"/>
             <transaction mode="NONE"/>
             <eviction strategy="NONE"/>
             <file-store path="/MRSD/data" purge="false" 
passivation="false" preload="true"/>
             <indexing index="LOCAL">
                             <property 
name="default.indexmanager">*org.infinispan.query.indexmanager.InfinispanIndexManager*</property>
                             <property 
name="default.directory_provider">*Infinispan*</property>
                             <property 
name="default.metadata_cachename">MRSD-INDEX_META_DATA</property>
                             <property 
name="default.data_cachename">MRSD-INDEX_DATA</property>
                            <property 
name="default.locking_cachename">MRSD-INDEX_LOCKING</property>
             </indexing>
</local-cache>
<local-cache name="MRSD-INDEX_META_DATA" start="EAGER">
              <indexing index="NONE"/>
             <file-store path="/MRSD/index/indexMetadata" shared="false" 
purge="false" passivation="false" preload="true" fetch-state="true" 
read-only="false"/>
  </local-cache>
  <local-cache name="MRSD-INDEX_DATA" start="EAGER">
           <indexing index="NONE"/>
           <file-store path="MRSD/index/indexData" shared="false" 
purge="false" passivation="false" preload="true" fetch-state="true" 
read-only="false"/>
</local-cache>
<local-cache name="MRSD-INDEX_LOCKING" start="EAGER">
           <indexing index="NONE"/>
           <file-store path="MRSD/index/indexLocking" shared="false" 
purge="false" passivation="false" preload="true" fetch-state="true" 
read-only="false"/>
</local-cache>


*Time Taken To Load Data: *3 Min 13 Sec*
*

*Number of Records :* 45024


/*_Case 2_ */: *(Data Loading is very quick, But issue with 
**"**OutOfMemoryError: Java heap space**"**)*

In this case I am storing the index into memory by using the below tag ,

/*<property name="default.directory_provider">ram</property>*/

I have observed that, data has loaded into cache with in some seconds 
for same number of records that mentioned in _Case 1_,

But in this case when i am trying the store the same number of 
records(*45024*) multiple times and retrieving the data in same duration 
, It is throwing *OutOfMemoryError: Java heap space *in 
/infinispan-server-8.2.4.Final/standalone/configuration/server.log./

/Below is local cache configuration,

/<local-cache name="MERCHANT_STORE_DETAILS" start="EAGER">
             <locking acquire-timeout="30000" concurrency-level="1000" 
striping="false"/>
                     <transaction mode="NONE"/>
                    <eviction strategy="NONE"/>
                     <indexing index="LOCAL">
                             <property 
name="default.indexmanager">near-real-time</property>
                             <property 
name="default.directory_provider">ram</property>
             </indexing>
</local-cache>


*Time Taken To Load Data: *32 Sec

*Number of Records :* 45024


_*Exception In Details

*_2017-01-09 06:38:31,777 ERROR [stderr] 
(HotRod-externalServerHandler-1-88) Exception in thread 
"HotRod-externalServerHandler-1-88" java.lang.OutOfMemoryError: Java 
heap space
2017-01-09 06:39:18,706 ERROR 
[org.hibernate.search.exception.impl.LogErrorHandler] (Lucene Merge 
Thread #7869 for index 
org.infinispan.query.remote.impl.indexing.ProtobufValueWrapper) 
HSEARCH000058: HSEARCH000118: Exception during index Merge operation: 
org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: Java heap space
         at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
         at 
org.hibernate.search.backend.impl.lucene.overrides.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:42)
         at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
Caused by: java.lang.OutOfMemoryError: Java heap space

2017-01-09 06:41:23,919 ERROR [stderr] 
(HotRod-externalServerHandler-1-88)      at 
org.antlr.runtime.Lexer.emit(Lexer.java:160)
2017-01-09 06:36:54,872 ERROR 
[org.jboss.as.controller.management-operation] 
(DeploymentScanner-threads - 2) WFLYCTL0013: Operation 
("read-children-resources") failed - address: ([]): 
java.lang.OutOfMemoryError: Java heap space
         at java.util.HashMap.resize(HashMap.java:703)
         at java.util.HashMap.putVal(HashMap.java:628)
         at java.util.HashMap.put(HashMap.java:611)
         at 
org.jboss.as.controller.OperationContextImpl$AuthorizationResponseImpl.addResourceResult(OperationContextImpl.java:2356)
         at 
org.jboss.as.controller.OperationContextImpl$AuthorizationResponseImpl.access$700(OperationContextImpl.java:2328)
         at 
org.jboss.as.controller.OperationContextImpl.getBasicAuthorizationResponse(OperationContextImpl.java:1764)
         at 
org.jboss.as.controller.OperationContextImpl.authorize(OperationContextImpl.java:1659)
         at 
org.jboss.as.controller.OperationContextImpl.authorize(OperationContextImpl.java:1618)
         at 
org.jboss.as.controller.OperationContextImpl.getResourceRegistration(OperationContextImpl.java:567)
         at 
org.jboss.as.controller.operations.global.ReadChildrenResourcesHandler.execute(ReadChildrenResourcesHandler.java:94)
         at 
org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:890)
         at 
org.jboss.as.controller.AbstractOperationContext.processStages(AbstractOperationContext.java:659)
         at 
org.jboss.as.controller.AbstractOperationContext.executeOperation(AbstractOperationContext.java:370)
         at 
org.jboss.as.controller.OperationContextImpl.executeOperation(OperationContextImpl.java:1344)
         at 
org.jboss.as.controller.ModelControllerImpl.internalExecute(ModelControllerImpl.java:392)
         at 
org.jboss.as.controller.ModelControllerImpl.execute(ModelControllerImpl.java:204)
         at 
org.jboss.as.controller.ModelControllerImpl$3.execute(ModelControllerImpl.java:659)
         at 
org.jboss.as.controller.ModelControllerImpl$3.execute(ModelControllerImpl.java:649)
         at 
org.jboss.as.server.deployment.scanner.DefaultDeploymentOperations.getDeploymentsStatus(DefaultDeploymentOperations.java:76)
         at 
org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$ScanContext.<init>(FileSystemDeploymentService.java:1614)
         at 
org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$ScanContext.<init>(FileSystemDeploymentService.java:1563)
         at 
org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:568)
         at 
org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:489)
         at 
org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentScanRunnable.run(FileSystemDeploymentService.java:250)
         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
         at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
         at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
         at org.jboss.threads.JBossThread.run(JBossThread.java:320)


2017-01-09 06:38:39,564 ERROR 
[org.infinispan.interceptors.InvocationContextInterceptor] 
(HotRod-externalServerHandler-1-107) ISPN000136: Error executing command 
PutKeyValueCommand, writing keys [[B0x4a1b313031323331..[29]]: 
java.lang.OutOfMemoryError: Java heap space
         at 
java.util.ResourceBundle.putBundleInCache(ResourceBundle.java:1694)
         at java.util.ResourceBundle.findBundle(ResourceBundle.java:1471)
         at java.util.ResourceBundle.findBundle(ResourceBundle.java:1419)
         at java.util.ResourceBundle.getBundleImpl(ResourceBundle.java:1361)
         at java.util.ResourceBundle.getBundle(ResourceBundle.java:890)
         at sun.util.resources.LocaleData$1.run(LocaleData.java:164)
         at sun.util.resources.LocaleData$1.run(LocaleData.java:160)
         at java.security.AccessController.doPrivileged(Native Method)
         at sun.util.resources.LocaleData.getBundle(LocaleData.java:160)
         at 
sun.util.resources.LocaleData.getNumberFormatData(LocaleData.java:156)
         at 
sun.util.locale.provider.LocaleResources.getNumberPatterns(LocaleResources.java:439)
         at 
sun.util.locale.provider.NumberFormatProviderImpl.getInstance(NumberFormatProviderImpl.java:177)
         at 
sun.util.locale.provider.NumberFormatProviderImpl.getNumberInstance(NumberFormatProviderImpl.java:149)
         at java.text.NumberFormat.getInstance(NumberFormat.java:875)
         at java.text.NumberFormat.getInstance(NumberFormat.java:861)
         at java.text.NumberFormat.getNumberInstance(NumberFormat.java:458)
         at org.infinispan.commons.util.Util.prettyPrintTime(Util.java:353)
         at 
org.infinispan.util.concurrent.locks.impl.DefaultLockManager$KeyAwareExtendedLockPromise.lock(DefaultLockManager.java:238)
         at 
org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockAndRecord(AbstractLockingInterceptor.java:193)
         at 
org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitNonTxDataWriteCommand(AbstractLockingInterceptor.java:98)
         at 
org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor.visitDataWriteCommand(NonTransactionalLockingInterceptor.java:41)
         at 
org.infinispan.interceptors.locking.AbstractLockingInterceptor.visitPutKeyValueCommand(AbstractLockingInterceptor.java:65)
         at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:78)
         at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:99)
         at 
org.infinispan.interceptors.CacheMgmtInterceptor.updateStoreStatistics(CacheMgmtInterceptor.java:191)
         at 
org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:177)
         at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:78)
         at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:99)
         at 
org.infinispan.interceptors.compat.BaseTypeConverterInterceptor.visitPutKeyValueCommand(BaseTypeConverterInterceptor.java:84)
         at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:78)
         at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:99)
         at 
org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:114)


Could any one please help me here to fix the "*OutOfMemoryError: Java 
heap space*" issue for _*Case 2.

*_Please let me know if you need more information on this.

Thanks in advance.
_*
*_
-- 
Aurus Signature

*________________________________________________________________________________________________________________________________________________________________*

*Thanks and Regards,*

*Sridhar Jena,* Sr. Techincal Lead, Products

*+91 - 20 - 27655062* | *+91 - 9226345267* | *sjena345* | 
*www.aurusinc.com* <http://www.aurusinc.com/>
*Plot G-2, Sector 26, Pradhikaran, Pune, Maharashtra-411044*

<http://www.aurusinc.com/>

<https://www.facebook.com/pages/Aurus-Inc-Solution-and-Services-Provider/168611626510639> 
<https://twitter.com/aurustech> <http://linkedin.com/company/aurustech> 
<https://plus.google.com/100924847781939597025>

/*Please consider the environment before printing this e-mail */

Disclaimers: This message contains confidential information and is 
intended only for the individual named. If you are not the named 
addressee you should not disseminate, distribute or copy this e-mail. 
Please notify the sender immediately by e-mail if you have received this 
e-mail by mistake and delete this e-mail from your system. E-mail 
transmission cannot be guaranteed to be secure or error-free as 
information could be intercepted, corrupted, lost, destroyed, arrive 
late or incomplete, or contain viruses. The sender therefore does not 
accept liability for any errors or omissions in the contents of this 
message, which arise as a result of e-mail transmission. If verification 
is required please request a hard-copy version.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics11
Type: image/png
Size: 1529 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0010.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics12
Type: image/png
Size: 1205 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0011.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics13
Type: image/png
Size: 1801 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0012.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics14
Type: image/png
Size: 1458 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0013.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics15
Type: image/png
Size: 1510 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0014.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Aurus
Type: image/png
Size: 6066 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0015.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics17
Type: image/png
Size: 2982 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0016.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics18
Type: image/png
Size: 3153 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0017.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics19
Type: image/png
Size: 3072 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0018.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graphics20
Type: image/png
Size: 1388 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20170110/892abeec/attachment-0019.png 


More information about the infinispan-dev mailing list