[JBoss JIRA] (ISPN-7517) Investigate Netty's "Too many open files" exception in testing of infinispan-compatibility-mode-it
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-7517?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo updated ISPN-7517:
------------------------------
Fix Version/s: 9.0.0.CR3
(was: 9.0.0.CR2)
> Investigate Netty's "Too many open files" exception in testing of infinispan-compatibility-mode-it
> --------------------------------------------------------------------------------------------------
>
> Key: ISPN-7517
> URL: https://issues.jboss.org/browse/ISPN-7517
> Project: Infinispan
> Issue Type: Task
> Components: Test Suite - Server
> Reporter: Sanne Grinovero
> Fix For: 9.0.0.CR3
>
>
> See also discussion on ML:
> - http://lists.jboss.org/pipermail/infinispan-dev/2017-February/017232.html
> Running:
> {noformat}
> mci -rf :infinispan-compatibility-mode-it
> {noformat}
> {noformat}
> Failed tests:
> ByteArrayKeyDistEmbeddedHotRodTest.setup:27 » IllegalState failed to create a ...
> ByteArrayKeyReplEmbeddedHotRodTest.setup:87 » IllegalState failed to create a ...
> ByteArrayValueDistEmbeddedHotRodTest.setup:27 » IllegalState failed to create ...
> ByteArrayValueReplEmbeddedHotRodTest.setup:87 » IllegalState failed to create ...
> DistEmbeddedRestHotRodTest.setup:25 » IllegalState failed to create a child ev...
> DistL1EmbeddedHotRodTest.setup:30 » IllegalState failed to create a child even...
> DistMemcachedEmbeddedTest.setup:39 » IllegalState failed to create a child eve...
> org.infinispan.it.compatibility.EmbeddedHotRodCacheListenerTest.setup(org.infinispan.it.compatibility.EmbeddedHotRodCacheListenerTest)
> Run 1: EmbeddedHotRodCacheListenerTest.setup:36 » IllegalState failed to create a chi...
> Run 2: PASS
> Run 3: PASS
> EmbeddedHotRodTest.testEventFilteringStatic:274->lambda$testEventFilteringStatic$4:276 » Transport
> EmbeddedMemcachedCacheListenerTest.setup:39 » IllegalState failed to create a ...
> EmbeddedRestMemcachedHotRodTest.setup:50 » IllegalState failed to create a chi...
> ReplEmbeddedRestHotRodTest.setup:38 » IllegalState failed to create a child ev...
> Tests run: 101, Failures: 12, Errors: 0, Skipped: 47
> {noformat}
> Errors are all about a similar stacktrace.
> {noformat}
> java.lang.IllegalStateException: failed to create a child event loop
> at io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:88)
> at io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:58)
> at io.netty.channel.MultithreadEventLoopGroup.<init>(MultithreadEventLoopGroup.java:51)
> at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:87)
> at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:82)
> at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:63)
> at io.netty.channel.nio.NioEventLoopGroup.<init>(NioEventLoopGroup.java:51)
> at org.jboss.resteasy.plugins.server.netty.NettyJaxrsServer.start(NettyJaxrsServer.java:239)
> at org.infinispan.rest.NettyRestServer.start(NettyRestServer.java:81)
> at org.infinispan.it.compatibility.CompatibilityCacheFactory.createRestCache(CompatibilityCacheFactory.java:199)
> at org.infinispan.it.compatibility.CompatibilityCacheFactory.createRestMemcachedCaches(CompatibilityCacheFactory.java:137)
> at org.infinispan.it.compatibility.CompatibilityCacheFactory.setup(CompatibilityCacheFactory.java:123)
> at org.infinispan.it.compatibility.DistMemcachedEmbeddedTest.setup(DistMemcachedEmbeddedTest.java:39)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
> at org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:564)
> at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:213)
> at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:138)
> at org.testng.internal.TestMethodWorker.invokeBeforeClassMethods(TestMethodWorker.java:175)
> at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:107)
> at org.testng.TestRunner.privateRun(TestRunner.java:767)
> at org.testng.TestRunner.run(TestRunner.java:617)
> at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
> at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
> at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
> at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: io.netty.channel.ChannelException: failed to open a new selector
> at io.netty.channel.nio.NioEventLoop.openSelector(NioEventLoop.java:157)
> at io.netty.channel.nio.NioEventLoop.<init>(NioEventLoop.java:148)
> at io.netty.channel.nio.NioEventLoopGroup.newChild(NioEventLoopGroup.java:126)
> at io.netty.channel.nio.NioEventLoopGroup.newChild(NioEventLoopGroup.java:36)
> at io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:84)
> ... 32 more
> Caused by: java.io.IOException: Too many open files
> at sun.nio.ch.EPollArrayWrapper.epollCreate(Native Method)
> at sun.nio.ch.EPollArrayWrapper.<init>(EPollArrayWrapper.java:130)
> at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:69)
> at sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:36)
> at io.netty.channel.nio.NioEventLoop.openSelector(NioEventLoop.java:155)
> ... 36 more
> {noformat}
> N.B.
> The failure is quite consistent on my workstation, almost always results in the same tests failing. Yet occasionally they all pass.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7509) TotalOrderStateTransferInterceptor doesn't handle OutdatedTopologyException for read commands
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-7509?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo updated ISPN-7509:
------------------------------
Fix Version/s: 9.0.0.CR3
(was: 9.0.0.CR2)
> TotalOrderStateTransferInterceptor doesn't handle OutdatedTopologyException for read commands
> ---------------------------------------------------------------------------------------------
>
> Key: ISPN-7509
> URL: https://issues.jboss.org/browse/ISPN-7509
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.0.0.CR1
> Reporter: Dan Berindei
> Assignee: Pedro Ruivo
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.0.0.CR3
>
>
> Since ISPN-6859, read commands can also trigger {{OutdatedTopologyException}}, but these are only handled in the non-TO {{StateTransferInterceptor}}. When a read should be retried because of a topology change in a TO cache, the {{OutdatedTopologyException}} is instead thrown to the user:
> {noformat}
> 16:50:40,595 DEBUG (jgroups-9,Test-NodeA-483:[]) [InvocationContextInterceptor] ISPN000311: Received a command from an outdated topology, returning the exception to caller
> org.infinispan.statetransfer.OutdatedTopologyException: Did not get any successful response, got {Test-NodeC-46564=UnsuccessfulResponse}
> 16:50:40,595 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.tx.totalorder.statetransfer.DistTotalOrderVersionedStateTransferTest.testStateTransfer
> org.infinispan.statetransfer.OutdatedTopologyException: Did not get any successful response, got {Test-NodeC-46564=UnsuccessfulResponse}
> {noformat}
> This causes random failures in {{DistTotalOrderVersionedStateTransferTest}}.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7477) Endpoints with non-default names are not parsed
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-7477?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo updated ISPN-7477:
------------------------------
Fix Version/s: 9.0.0.CR3
(was: 9.0.0.CR2)
> Endpoints with non-default names are not parsed
> ------------------------------------------------
>
> Key: ISPN-7477
> URL: https://issues.jboss.org/browse/ISPN-7477
> Project: Infinispan
> Issue Type: Bug
> Components: Console
> Affects Versions: 9.0.0.CR1
> Reporter: Vladimir Blagojevic
> Assignee: Vladimir Blagojevic
> Fix For: 9.0.0.CR3
>
> Attachments: domain.xml
>
>
> When we parse endpoints from DMR we assume that they have certain names. In addition, we can not parse multiple endpoints of the same type (hotrod, rest etc) and finally we assume that they belong to a certain container which might not be the case.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month