[infinispan-dev] Caused by: java.lang.OutOfMemoryError: unable to create new native thread

[Andreas Kruthoff]

Hi infinispan-dev


I'm running 2 processes with 2 distributed caches each, standard
jgroups-tcp configutation. Both caches have a local dat file which is
loaded during startup, passivation is true. Each cache contains ~20Mio.
entries.

I'm writing with async put, peak is over 10'000 entries per second. It
performs well.

cache.getAdvancedCache()
     .withFlags(Flag.SKIP_REMOTE_LOOKUP, Flag.SKIP_CACHE_LOAD)
     .putIfAbsentAsync(Long.valueOf(a), Long.valueOf(b));

As soon as I launch a 3rd process to join the 2 caches, I'm getting the
following exception (see below).

Does anyone know what I need to tune. It looks like the OS doesn't offer
enough resources, or am I wrong? The server has plenty of RAM and CPU's.
I'm launching without -Xmx, but with -XX:+UseG1GC.


Any help is much appreciated

-andreas


Exception in thread "main"
org.infinispan.manager.EmbeddedCacheManagerStartupException:
org.infinispan.commons.CacheException: Unable to invoke method public
void org.infinispan.remoting.transport.jgroups.JGroupsTransport.start()
on object of type JGroupsTransport
         at
org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:243)
         at
org.infinispan.manager.DefaultCacheManager.wireAndStartCache(DefaultCacheManager.java:573)
         at
org.infinispan.manager.DefaultCacheManager.createCache(DefaultCacheManager.java:539)
         at
org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:416)
         at ch.nexustelecom.lbd.engine.ImsiCache.init(ImsiCache.java:49)
         at
ch.nexustelecom.dexclient.engine.DefaultDexClientEngine.init(DefaultDexClientEngine.java:120)
         at
ch.nexustelecom.dexclient.DexClient.initClient(DexClient.java:169)
         at
ch.nexustelecom.dexclient.tool.DexClientManager.startup(DexClientManager.java:196)
         at
ch.nexustelecom.dexclient.tool.DexClientManager.main(DexClientManager.java:83)
Caused by: org.infinispan.commons.CacheException: Unable to invoke
method public void
org.infinispan.remoting.transport.jgroups.JGroupsTransport.start() on
object of type JGroupsTransport
         at
org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:170)
         at
org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:869)
         at
org.infinispan.factories.AbstractComponentRegistry.invokeStartMethods(AbstractComponentRegistry.java:638)
         at
org.infinispan.factories.AbstractComponentRegistry.internalStart(AbstractComponentRegistry.java:627)
         at
org.infinispan.factories.AbstractComponentRegistry.start(AbstractComponentRegistry.java:530)
         at
org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:221)
         ... 8 more
Caused by: java.lang.OutOfMemoryError: unable to create new native thread
         at java.lang.Thread.start0(Native Method)
         at java.lang.Thread.start(Thread.java:714)
         at
org.jgroups.protocols.FD_SOCK$ServerSocketHandler.start(FD_SOCK.java:1006)
         at
org.jgroups.protocols.FD_SOCK$ServerSocketHandler.<init>(FD_SOCK.java:999)
         at org.jgroups.protocols.FD_SOCK.init(FD_SOCK.java:188)
         at
org.jgroups.stack.ProtocolStack.initProtocolStack(ProtocolStack.java:860)
         at org.jgroups.stack.ProtocolStack.setup(ProtocolStack.java:481)
         at org.jgroups.JChannel.init(JChannel.java:848)
         at org.jgroups.JChannel.<init>(JChannel.java:159)
         at org.jgroups.JChannel.<init>(JChannel.java:129)
         at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.buildChannel(JGroupsTransport.java:381)
         at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.initChannel(JGroupsTransport.java:286)
         at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.initChannelAndRPCDispatcher(JGroupsTransport.java:330)
         at
org.infinispan.remoting.transport.jgroups.JGroupsTransport.start(JGroupsTransport.java:189)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
         at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         at java.lang.reflect.Method.invoke(Method.java:606)
         at
org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:168)
         ... 13 more

This email and any attachment may contain confidential information which is intended for use only by the addressee(s) named above. If you received this email by mistake, please notify the sender immediately, and delete the email from your system. You are prohibited from copying, disseminating or otherwise using the email or any attachment.