January 2018 - infinispan-issues - Jboss List Archives

[JBoss JIRA] (ISPN-8731) Write command times out waiting for wrong topology

by Dan Berindei (JIRA)

Dan Berindei created ISPN-8731: ---------------------------------- Summary: Write command times out waiting for wrong topology Key: ISPN-8731 URL: https://issues.jboss.org/browse/ISPN-8731 Project: Infinispan Issue Type: Bug Components: Core, Test Suite - Query, Test Suite - Server Affects Versions: 9.2.0.CR1 Reporter: Dan Berindei Priority: Blocker Fix For: 9.2.0.CR2 {{MultipleCacheManagersTest.waitForClusterToForm(new String[]{})}} doesn't actually wait for the rebalance to finish everywhere: https://github.com/infinispan/infinispan/pull/5705/files#diff-f9f535214b9... Most tests should work regardless of whether we wait for the rebalance to finish or not, it's just a way to reduce the number of test failures when the command retry doesn't work. Waiting for the rebalance to finish is only required when the test needs to install new topologies in a specific order. However, some recent test failures in CI show that the effectiveness of {{MultipleCacheManagersTest.waitForClusterToForm(new String[]{})}} does make a difference. Most likely there is a bug in the retry logic during the latter phases of a rebalance, and the retry-specific tests do not cover all the scenarios. {noformat} 00:23:20,668 DEBUG (remote-thread-ClusteredScriptingTest-NodeI-p218-t5:[]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredScriptingTest-NodeI-40041: 134, ClusteredScriptingTest-NodeJ-9982: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredScriptingTest-NodeI-40041, ClusteredScriptingTest-NodeJ-9982], persistentUUIDs=[91a47fef-fad6-479c-9ec9-12e9350dc6d5, d2200930-5793-4b74-beea-e001a2b414c1]}, availability mode = AVAILABLE 00:23:20,669 DEBUG (remote-thread-ClusteredScriptingTest-NodeI-p218-t5:[]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredScriptingTest-NodeI-40041: 134, ClusteredScriptingTest-NodeJ-9982: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredScriptingTest-NodeI-40041, ClusteredScriptingTest-NodeJ-9982], persistentUUIDs=[91a47fef-fad6-479c-9ec9-12e9350dc6d5, d2200930-5793-4b74-beea-e001a2b414c1]} 00:23:20,669 DEBUG (transport-thread-ClusteredScriptingTest-NodeI-p220-t6:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating local topology for cache ___defaultcache: CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredScriptingTest-NodeI-40041: 134, ClusteredScriptingTest-NodeJ-9982: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredScriptingTest-NodeI-40041, ClusteredScriptingTest-NodeJ-9982], persistentUUIDs=[91a47fef-fad6-479c-9ec9-12e9350dc6d5, d2200930-5793-4b74-beea-e001a2b414c1]} 00:23:20,669 DEBUG (transport-thread-ClusteredScriptingTest-NodeJ-p234-t6:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating local topology for cache ___defaultcache: CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredScriptingTest-NodeI-40041: 134, ClusteredScriptingTest-NodeJ-9982: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredScriptingTest-NodeI-40041, ClusteredScriptingTest-NodeJ-9982], persistentUUIDs=[91a47fef-fad6-479c-9ec9-12e9350dc6d5, d2200930-5793-4b74-beea-e001a2b414c1]} 00:23:35,673 ERROR (timeout-thread-ClusteredScriptingTest-NodeI-p219-t1:[]) [InvocationContextInterceptor] ISPN000136: Error executing command PutKeyValueCommand, writing keys [/macbeth.txt0] org.infinispan.util.concurrent.TimeoutException: Timed out waiting for topology 6 at org.infinispan.interceptors.impl.BaseStateTransferInterceptor$CancellableRetry.run(BaseStateTransferInterceptor.java:333) [infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] 00:23:35,673 DEBUG (testng-ClusteredScriptingTest:[]) [DefaultCacheManager] Stopping cache manager ISPN on ClusteredScriptingTest-NodeJ-9982 00:23:35,682 DEBUG (remote-thread-ClusteredScriptingTest-NodeI-p218-t5:[]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=6, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (1)[ClusteredScriptingTest-NodeI-40041: 256]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredScriptingTest-NodeI-40041], persistentUUIDs=[91a47fef-fad6-479c-9ec9-12e9350dc6d5]}, availability mode = AVAILABLE 00:23:35,699 ERROR (testng-ClusteredScriptingTest:[]) [TestSuiteProgress] Test failed: org.infinispan.scripting.ClusteredScriptingTest.testDistributedMapReduceStreamWithFlag([REPL_SYNC]) org.infinispan.util.concurrent.TimeoutException: Timed out waiting for topology 6 at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:259) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1636) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1284) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1750) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:217) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.AbstractDelegatingCache.put(AbstractDelegatingCache.java:358) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.EncoderCache.put(EncoderCache.java:671) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.scripting.utils.ScriptingUtils.loadData(ScriptingUtils.java:29) ~[test-classes/:?] at org.infinispan.scripting.ClusteredScriptingTest$6.call(ClusteredScriptingTest.java:144) ~[test-classes/:?] at org.infinispan.test.TestingUtil.withCacheManagers(TestingUtil.java:1522) ~[infinispan-core-9.2.0-SNAPSHOT-tests.jar:9.2.0-SNAPSHOT] at org.infinispan.scripting.ClusteredScriptingTest.testDistributedMapReduceStreamWithFlag(ClusteredScriptingTest.java:137) ~[test-classes/:?] {noformat} {noformat} 18:04:17,097 DEBUG (transport-thread-ClusteredCacheTest-NodeB-p3689-t1:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating local topology for cache ___defaultcache: CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredCacheTest-NodeA-53655: 134, ClusteredCacheTest-NodeB-27398: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredCacheTest-NodeA-53655, ClusteredCacheTest-NodeB-27398], persistentUUIDs=[5f5b2dd6-c570-4c6c-9c2d-92aa5fcd2362, b623ac7a-3c77-471d-88de-e151da823c0c]} 18:04:17,097 INFO (testng-ClusteredCacheTest:[]) [TestSuiteProgress] Test starting: org.infinispan.query.blackbox.ClusteredCacheTest.testConditionalRemoveFromNonOwner 18:04:17,097 DEBUG (transport-thread-ClusteredCacheTest-NodeA-p3679-t5:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating local topology for cache ___defaultcache: CacheTopology{id=5, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[ClusteredCacheTest-NodeA-53655: 134, ClusteredCacheTest-NodeB-27398: 122]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredCacheTest-NodeA-53655, ClusteredCacheTest-NodeB-27398], persistentUUIDs=[5f5b2dd6-c570-4c6c-9c2d-92aa5fcd2362, b623ac7a-3c77-471d-88de-e151da823c0c]} 18:04:32,100 ERROR (timeout-thread-ClusteredCacheTest-NodeA-p3678-t1:[]) [InvocationContextInterceptor] ISPN000136: Error executing command PutKeyValueCommand, writing keys [WrappedByteArray{bytes=[B0x010201054E617669..[9], hashCode=-1707624030}] org.infinispan.util.concurrent.TimeoutException: Timed out waiting for topology 6 at org.infinispan.interceptors.impl.BaseStateTransferInterceptor$CancellableRetry.run(BaseStateTransferInterceptor.java:333) [infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] 18:04:32,101 ERROR (testng-ClusteredCacheTest:[]) [TestSuiteProgress] Test failed: org.infinispan.query.blackbox.ClusteredCacheTest.testConditionalRemoveFromNonOwner org.infinispan.util.concurrent.TimeoutException: Timed out waiting for topology 6 at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:259) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.executeCommandAndCommitIfNeeded(CacheImpl.java:1636) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1284) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:1750) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.CacheImpl.put(CacheImpl.java:217) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.AbstractDelegatingCache.put(AbstractDelegatingCache.java:358) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.cache.impl.EncoderCache.put(EncoderCache.java:671) ~[infinispan-core-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT] at org.infinispan.query.blackbox.ClusteredCacheTest.prepareTestData(ClusteredCacheTest.java:140) ~[test-classes/:?] at org.infinispan.query.blackbox.ClusteredCacheTest.testConditionalRemoveFrom(ClusteredCacheTest.java:334) ~[test-classes/:?] at org.infinispan.query.blackbox.ClusteredCacheTest.testConditionalRemoveFromNonOwner(ClusteredCacheTest.java:298) ~[test-classes/:?] 18:04:32,214 DEBUG (testng-ClusteredCacheTest:[]) [DefaultCacheManager] Stopping cache manager ISPN on ClusteredCacheTest-NodeB-27398 18:04:32,479 DEBUG (remote-thread-ClusteredCacheTest-NodeA-p3677-t6:[]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=6, phase=NO_REBALANCE, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (1)[ClusteredCacheTest-NodeA-53655: 256]}, pendingCH=null, unionCH=null, actualMembers=[ClusteredCacheTest-NodeA-53655], persistentUUIDs=[5f5b2dd6-c570-4c6c-9c2d-92aa5fcd2362]}, availability mode = AVAILABLE {noformat} -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8427) Support for non-String keys in the rest server

by Tristan Tarrant (JIRA)

[ https://issues.jboss.org/browse/ISPN-8427?page=com.atlassian.jira.plugin.... ] Tristan Tarrant updated ISPN-8427: ---------------------------------- Status: Resolved (was: Pull Request Sent) Fix Version/s: 9.2.0.Final 9.2.0.CR2 Resolution: Done > Support for non-String keys in the rest server > ---------------------------------------------- > > Key: ISPN-8427 > URL: https://issues.jboss.org/browse/ISPN-8427 > Project: Infinispan > Issue Type: Enhancement > Components: Server > Affects Versions: 9.2.0.Alpha1 > Reporter: Gustavo Fernandes > Assignee: Gustavo Fernandes > Fix For: 9.2.0.Final, 9.2.0.CR2 > > > The rest server assumes keys are always String, causing limited interoperability between remote endpoints. > When a cache is written via Hot Rod, by default keys will be stored as {{byte[]}} produced via {{JBossMarshaller}} (the default marshaller), or a UTF-8 byte[] in case the {{UT8Marshaller}} is chosen. > The Rest server should accept keys in different formats than String, using an encoding for byte[] values like Base64, and pass in an special header with the key media type so that the server can use it. > With this capability, compat mode could be avoided when writing from Hot Rod and reading from Rest and vice versa -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8708) Remote iteration with limited batch sends finished segments too early

by William Burns (JIRA)

[ https://issues.jboss.org/browse/ISPN-8708?page=com.atlassian.jira.plugin.... ] William Burns updated ISPN-8708: -------------------------------- Status: Pull Request Sent (was: Coding In Progress) Git Pull Request: https://github.com/infinispan/infinispan/pull/5707 > Remote iteration with limited batch sends finished segments too early > --------------------------------------------------------------------- > > Key: ISPN-8708 > URL: https://issues.jboss.org/browse/ISPN-8708 > Project: Infinispan > Issue Type: Bug > Components: Server > Affects Versions: 9.2.0.Beta2 > Reporter: Radim Vansa > Assignee: William Burns > Fix For: 9.2.0.Final > > Attachments: infinispan-infinispan-client-hotrod.log.zip > > > When a remote cache is iterated and we limit maximum number of entries in one response, we might get the list of finished segments before the entry is actually sent to the client. -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8730) Need to update infinispan-defaults.xml to no longer used deprecated configs

by William Burns (JIRA)

William Burns created ISPN-8730: ----------------------------------- Summary: Need to update infinispan-defaults.xml to no longer used deprecated configs Key: ISPN-8730 URL: https://issues.jboss.org/browse/ISPN-8730 Project: Infinispan Issue Type: Bug Components: Server Affects Versions: 9.2.0.CR1 Reporter: William Burns The infinispan-defaults.xml [1] uses store as binary and data container equivalence configurations. These are no longer used and should be removed. [1] https://github.com/infinispan/infinispan/blob/c19e5f40bd554bfe263fed21424... -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8729) Use async operations in Hot Rod server

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8729?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes commented on ISPN-8729: ----------------------------------------- What if a certain command blocks? Netty's eventloop thread may be serving a few channels which will become unresponsive as a result > Use async operations in Hot Rod server > -------------------------------------- > > Key: ISPN-8729 > URL: https://issues.jboss.org/browse/ISPN-8729 > Project: Infinispan > Issue Type: Enhancement > Components: Server > Affects Versions: 9.2.0.CR1 > Reporter: Radim Vansa > Assignee: Radim Vansa > > The server should avoid context switches by starting commands directly from event loop instead of handing them off to another executor. This requires ISPN-8336 to make the async chain completely non-blocking. > Along with the overhaul we should structure cache/counter/multimap operations nicely. -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8727) REST endpoint MBean is called REST-REST

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8727?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes updated ISPN-8727: ------------------------------------ Status: Resolved (was: Pull Request Sent) Fix Version/s: 9.2.0.CR2 Resolution: Done > REST endpoint MBean is called REST-REST > --------------------------------------- > > Key: ISPN-8727 > URL: https://issues.jboss.org/browse/ISPN-8727 > Project: Infinispan > Issue Type: Bug > Components: JMX, reporting and management > Affects Versions: 9.2.0.CR1 > Reporter: Martin Gencur > Assignee: Martin Gencur > Priority: Minor > Fix For: 9.2.0.CR2 > > Attachments: REST-REST.png > > > The MBean for REST endpoint is called REST-REST when the endpoint xml tag doesn't have any name attribute. This is different for HotRod and Memcached where they have correct names (i.e. "HotRod", "Memcached") . Attaching a screenshot. -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8396) Add interceptor preventing going out of memory

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8396?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes updated ISPN-8396: ------------------------------------ Git Pull Request: https://github.com/infinispan/infinispan/pull/5675, https://github.com/infinispan/infinispan/pull/5694 (was: https://github.com/infinispan/infinispan/pull/5675) > Add interceptor preventing going out of memory > ---------------------------------------------- > > Key: ISPN-8396 > URL: https://issues.jboss.org/browse/ISPN-8396 > Project: Infinispan > Issue Type: Feature Request > Components: Cloud, Core > Reporter: Sebastian Łaskawiec > Assignee: William Burns > Fix For: 9.2.0.CR1, 9.2.0.Final > > > We need an interceptor which will calculate the amount of required memory for PUT and report an error if that put will cause going out of memory. > Note that this is strictly connected to eviction mechanism (we might want to evict some entries on write) -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8619) Rewrite Hot Rod client using Netty

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8619?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes updated ISPN-8619: ------------------------------------ Status: Open (was: New) > Rewrite Hot Rod client using Netty > ---------------------------------- > > Key: ISPN-8619 > URL: https://issues.jboss.org/browse/ISPN-8619 > Project: Infinispan > Issue Type: Sub-task > Components: Remote Protocols > Reporter: Radim Vansa > Assignee: Radim Vansa > Fix For: 9.2.0.CR2 > > -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8619) Rewrite Hot Rod client using Netty

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8619?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes updated ISPN-8619: ------------------------------------ Status: Pull Request Sent (was: Open) Git Pull Request: https://github.com/infinispan/infinispan/pull/5646 > Rewrite Hot Rod client using Netty > ---------------------------------- > > Key: ISPN-8619 > URL: https://issues.jboss.org/browse/ISPN-8619 > Project: Infinispan > Issue Type: Sub-task > Components: Remote Protocols > Reporter: Radim Vansa > Assignee: Radim Vansa > Fix For: 9.2.0.CR2 > > -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-8619) Rewrite Hot Rod client using Netty

by Gustavo Fernandes (JIRA)

[ https://issues.jboss.org/browse/ISPN-8619?page=com.atlassian.jira.plugin.... ] Gustavo Fernandes updated ISPN-8619: ------------------------------------ Status: Resolved (was: Pull Request Sent) Fix Version/s: 9.2.0.CR2 Resolution: Done > Rewrite Hot Rod client using Netty > ---------------------------------- > > Key: ISPN-8619 > URL: https://issues.jboss.org/browse/ISPN-8619 > Project: Infinispan > Issue Type: Sub-task > Components: Remote Protocols > Reporter: Radim Vansa > Assignee: Radim Vansa > Fix For: 9.2.0.CR2 > > -- This message was sent by Atlassian JIRA (v7.5.0#75005)

8 years, 2 months

1
0
0 / 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

infinispan-issues January 2018