[infinispan-dev] Memory consumption of org.infinispan.marshall.core.JBossMarshaller

[Christian Beikov]

Are you going to do something about this memory consumption or is there 
at least some kind of minimum expected memory usage you can give me?
I ran into an OOMEs the other day and the cluster was unable to recover 
from that by restarting single nodes. The nodes couldn't synchronize 
because of the OOMEs. I had to (jgroups-)disconnect all nodes from the 
cluster and start a separate cluster which of course lead to data loss.
All of this happened because of some wrong memory consumption 
estimations I made so in order to avoid that in the future I would like 
to plan better ahead. Is there any other way to avoid such a cluster death?

Regards,
Christian

Am 26.11.2015 um 15:56 schrieb Galder Zamarreño:
> Those IdentityIntMap are caches meant to speed up serialization if the same objects or types are marshalled again. It's normal for them to be populated as marshalling operations are executed. We don't currently have a way to clear these caches.
>
> Cheers,
> --
> Galder Zamarreño
> Infinispan, Red Hat
>
>> On 22 Nov 2015, at 15:00, Christian Beikov <christian at sweazer.com> wrote:
>>
>> Hello,
>>
>> In a recent heap dump analysis I found that
>> org.infinispan.marshall.core.JBossMarshaller consumes a lot of
>> memory(about 46 MB) that seems to be unused.
>> This is due to PerThreadInstanceHolder having ExtendedRiverMarshaller
>> objects that contain big IdentityIntMap objects. Some of those
>> IdentityIntMap instances have a size of 2 million entries, but most of
>> them have sizes of a few 100 thousands.
>> When I look into these IdentityIntMap instances, it seems that the
>> entries are all unused.
>>
>> Is that kind of memory consumption expected or does that indicate a
>> possibly wrong configuration?
>>
>> I am using Infinispan 7.2.4.Final on Wildfly 9.0.1.Final.
>> _______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev