[
https://issues.redhat.com/browse/ISPN-10236?page=com.atlassian.jira.plugi...
]
Dan Berindei commented on ISPN-10236:
-------------------------------------
A new failure mode appeared recently:
{noformat}
org.infinispan.client.hotrod.exceptions.TransportException::
java.util.concurrent.RejectedExecutionException: Pool was terminated
at org.infinispan.client.hotrod.impl.Util.rewrap(Util.java:81)
at org.infinispan.client.hotrod.impl.Util.await(Util.java:54)
at org.infinispan.client.hotrod.impl.RemoteCacheImpl.put(RemoteCacheImpl.java:344)
at org.infinispan.client.hotrod.impl.RemoteCacheSupport.put(RemoteCacheSupport.java:79)
at
org.infinispan.client.hotrod.retry.ServerFailureRetryTest.testRetryCacheStopped(ServerFailureRetryTest.java:63)
at org.infinispan.commons.test.TestNGLongTestsHook.run(TestNGLongTestsHook.java:24)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.util.concurrent.RejectedExecutionException: Pool was terminated
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelPool.close(ChannelPool.java:249)
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelFactory.updateTopologyInfo(ChannelFactory.java:372)
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelFactory.updateServers(ChannelFactory.java:318)
at
org.infinispan.client.hotrod.impl.protocol.Codec20.readNewTopologyAndHash(Codec20.java:416)
at
org.infinispan.client.hotrod.impl.protocol.Codec20.readNewTopologyIfPresent(Codec20.java:374)
at org.infinispan.client.hotrod.impl.protocol.Codec20.readHeader(Codec20.java:169)
at
org.infinispan.client.hotrod.impl.transport.netty.HeaderDecoder.decode(HeaderDecoder.java:139)
at
org.infinispan.client.hotrod.impl.transport.netty.HintedReplayingDecoder.callDecode(HintedReplayingDecoder.java:94)
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:281)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
at
io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:502)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407)
at
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
... 3 more
... Removed 18 stack frames
{noformat}
Hotrod client error releasing channel after server cache stop
-------------------------------------------------------------
Key: ISPN-10236
URL:
https://issues.redhat.com/browse/ISPN-10236
Project: Infinispan
Issue Type: Bug
Components: Test Suite
Affects Versions: 10.0.0.Beta3
Reporter: Dan Berindei
Assignee: Dan Berindei
Priority: Major
Labels: testsuite_stability
Fix For: 10.1.0.Final
Attachments:
ISPN-10137_package_private_scope_20190524-1732_ServerFailureRetryTest-infinispan-client-hotrod.log.gz
Random failure in {{ServerFailureRetryTest.testRetryCacheStopped}} caused by an assert
statement in {{ChannelPool.release()}}.
{noformat}
17:37:36,562 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed:
org.infinispan.client.hotrod.retry.ServerFailureRetryTest.testRetryCacheStopped
java.lang.AssertionError: Error releasing [id: 0x5d9755e6, L:/127.0.0.1:42472 !
R:127.0.0.1/127.0.0.1:44865]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelPool.release(ChannelPool.java:170)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelFactory.releaseChannel(ChannelFactory.java:309)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.operations.HotRodOperation.releaseChannel(HotRodOperation.java:105)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.operations.RetryOnFailureOperation.invoke(RetryOnFailureOperation.java:80)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelPool.activateChannel(ChannelPool.java:217)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelPool.acquire(ChannelPool.java:86)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelFactory.fetchChannelAndInvoke(ChannelFactory.java:259)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.transport.netty.ChannelFactory.fetchChannelAndInvoke(ChannelFactory.java:297)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.operations.AbstractKeyOperation.fetchChannelAndInvoke(AbstractKeyOperation.java:41)
~[classes/:?]
at
org.infinispan.client.hotrod.impl.operations.RetryOnFailureOperation.execute(RetryOnFailureOperation.java:61)
~[classes/:?]
at org.infinispan.client.hotrod.impl.RemoteCacheImpl.putAsync(RemoteCacheImpl.java:366)
~[classes/:?]
at org.infinispan.client.hotrod.impl.RemoteCacheImpl.put(RemoteCacheImpl.java:334)
~[classes/:?]
at org.infinispan.client.hotrod.impl.RemoteCacheSupport.put(RemoteCacheSupport.java:79)
~[classes/:?]
at
org.infinispan.client.hotrod.retry.ServerFailureRetryTest.testRetryCacheStopped(ServerFailureRetryTest.java:63)
~[test-classes/:?]
{noformat}
I investigated a bit and I couldn't find an obvious mistake in the way
{{ChannelPool.created}} is incremented and decremented, but I think it would help if
access to it and {{ChannelPool.active}} were centralized in a smaller number of methods.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)