[JBoss JIRA] (ISPN-7710) CompatibilityProtoStreamMarshaller can't be set in server
by Adrian Nistor (JIRA)
[ https://issues.jboss.org/browse/ISPN-7710?page=com.atlassian.jira.plugin.... ]
Adrian Nistor commented on ISPN-7710:
-------------------------------------
After integrating https://github.com/infinispan/infinispan/pull/5233 you can easily add an arbitrary custom marshaller from a user's module without having to alter infinispan module dependencies.
> CompatibilityProtoStreamMarshaller can't be set in server
> ---------------------------------------------------------
>
> Key: ISPN-7710
> URL: https://issues.jboss.org/browse/ISPN-7710
> Project: Infinispan
> Issue Type: Bug
> Components: Server
> Affects Versions: 9.0.0.Final
> Reporter: Galder Zamarreño
> Assignee: Galder Zamarreño
> Fix For: 9.1.0.Final, 9.0.3.Final
>
>
> Out of the box, it's impossible to set compatibility marshaller to {{org.infinispan.query.remote.CompatibilityProtoStreamMarshaller}} in server because {{org.infinispan.main}} classloader can't access that class.
> As [~dan.berindei] suggested in the mailing list, one way to avoid these kind of issues would be to allow class definitions to have {{slot:module:class}} format so that using the ModularClassResolver any class can be found.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-8002) ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-8002?page=com.atlassian.jira.plugin.... ]
Dan Berindei commented on ISPN-8002:
------------------------------------
It is much easier to reproduce when the CH is deterministic, as in https://github.com/infinispan/infinispan/pull/5253
> ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
> ----------------------------------------------------------------------
>
> Key: ISPN-8002
> URL: https://issues.jboss.org/browse/ISPN-8002
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.1.0.CR1
> Reporter: Dan Berindei
> Assignee: Radim Vansa
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
> Attachments: ScatteredStreamIteratorTest_ISPN-7998_ConsistentHash.getNumOwners_20170629.log.gz
>
>
> {noformat}
> 20:38:39,442 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.scattered.stream.ScatteredStreamIteratorTest.waitUntilProcessingResults[SCATTERED_SYNC, tx=false]
> java.lang.NullPointerException: null
> at org.infinispan.stream.DistributedStreamIteratorTest.waitUntilProcessingResults(DistributedStreamIteratorTest.java:207) ~[test-classes/:?]
> {noformat}
> Looks like segments {{ScatteredVersionManager}} blocks access to segments 10 and 12, and they are never suspected or retried:
> {noformat}
> 20:38:38,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-0 completed segments [6, 7, 13, 14, 15] with [] suspected segments
> 20:38:38,248 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 10, 11, 12] lost segments for Test-NodeBD-1062-0
> 20:38:38,249 TRACE (transport-thread-Test-NodeBD-p13301-t4:[Topology-org.infinispan.scattered.stream.Test]) [ScatteredVersionManager] Node Test-NodeBD-1062 blocks access to segment 10
> 20:38:38,253 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeBF-40292={8-9 11}} for id Test-NodeBD-1062-1
> 20:38:39,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-1 completed segments [] with [8, 9, 11] suspected segments
> 20:38:39,302 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 11] lost segments for Test-NodeBD-1062-1
> 20:38:39,420 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-2 completed segments [8, 9, 11] with [] suspected segments
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 2, 3, 4, 5]
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[])
> {noformat}
> Please also add a {{toString()}} method in the stream commands, seeing the segments in the requests and responses would make it easier to follow the logs.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-8002) ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-8002?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-8002:
-------------------------------
Status: Open (was: New)
> ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
> ----------------------------------------------------------------------
>
> Key: ISPN-8002
> URL: https://issues.jboss.org/browse/ISPN-8002
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.1.0.CR1
> Reporter: Dan Berindei
> Assignee: Radim Vansa
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
> Attachments: ScatteredStreamIteratorTest_ISPN-7998_ConsistentHash.getNumOwners_20170629.log.gz
>
>
> {noformat}
> 20:38:39,442 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.scattered.stream.ScatteredStreamIteratorTest.waitUntilProcessingResults[SCATTERED_SYNC, tx=false]
> java.lang.NullPointerException: null
> at org.infinispan.stream.DistributedStreamIteratorTest.waitUntilProcessingResults(DistributedStreamIteratorTest.java:207) ~[test-classes/:?]
> {noformat}
> Looks like segments {{ScatteredVersionManager}} blocks access to segments 10 and 12, and they are never suspected or retried:
> {noformat}
> 20:38:38,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-0 completed segments [6, 7, 13, 14, 15] with [] suspected segments
> 20:38:38,248 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 10, 11, 12] lost segments for Test-NodeBD-1062-0
> 20:38:38,249 TRACE (transport-thread-Test-NodeBD-p13301-t4:[Topology-org.infinispan.scattered.stream.Test]) [ScatteredVersionManager] Node Test-NodeBD-1062 blocks access to segment 10
> 20:38:38,253 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeBF-40292={8-9 11}} for id Test-NodeBD-1062-1
> 20:38:39,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-1 completed segments [] with [8, 9, 11] suspected segments
> 20:38:39,302 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 11] lost segments for Test-NodeBD-1062-1
> 20:38:39,420 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-2 completed segments [8, 9, 11] with [] suspected segments
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 2, 3, 4, 5]
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[])
> {noformat}
> Please also add a {{toString()}} method in the stream commands, seeing the segments in the requests and responses would make it easier to follow the logs.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-7997) DistributedStreamIteratorTest.testLocallyForcedStream random failure
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7997?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-7997:
-------------------------------
Status: Pull Request Sent (was: Open)
Git Pull Request: https://github.com/infinispan/infinispan/pull/5253
> DistributedStreamIteratorTest.testLocallyForcedStream random failure
> --------------------------------------------------------------------
>
> Key: ISPN-7997
> URL: https://issues.jboss.org/browse/ISPN-7997
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 9.1.0.Beta1
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
>
> The test uses the {{MagicKey(primary, backup...)}} constructor with only 16 segments and with the default {{SyncConsistentHashFactory}}. Since SCHF is based on the random addresses of the nodes, the combination of owners is not always possible:
> {noformat}
> testLocallyForcedStream[DIST_SYNC, tx=false](org.infinispan.stream.DistributedStreamIteratorTest) Time elapsed: 0.015 sec <<< FAILURE! java.lang.IllegalStateException: Could not find any segment owned by Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAM-5250, [Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678], primary segments: {1-3 5 10 14}, backup segments: {Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678={0 8-9 13}}
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:88)
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:137)
> at org.infinispan.stream.DistributedStreamIteratorTest.magicKey(DistributedStreamIteratorTest.java:324)
> at org.infinispan.stream.DistributedStreamIteratorTest.testLocallyForcedStream(DistributedStreamIteratorTest.java:297)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-7997) DistributedStreamIteratorTest.testLocallyForcedStream random failure
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7997?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-7997:
-------------------------------
Fix Version/s: 9.1.0.Final
> DistributedStreamIteratorTest.testLocallyForcedStream random failure
> --------------------------------------------------------------------
>
> Key: ISPN-7997
> URL: https://issues.jboss.org/browse/ISPN-7997
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 9.1.0.Beta1
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
>
> The test uses the {{MagicKey(primary, backup...)}} constructor with only 16 segments and with the default {{SyncConsistentHashFactory}}. Since SCHF is based on the random addresses of the nodes, the combination of owners is not always possible:
> {noformat}
> testLocallyForcedStream[DIST_SYNC, tx=false](org.infinispan.stream.DistributedStreamIteratorTest) Time elapsed: 0.015 sec <<< FAILURE! java.lang.IllegalStateException: Could not find any segment owned by Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAM-5250, [Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678], primary segments: {1-3 5 10 14}, backup segments: {Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678={0 8-9 13}}
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:88)
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:137)
> at org.infinispan.stream.DistributedStreamIteratorTest.magicKey(DistributedStreamIteratorTest.java:324)
> at org.infinispan.stream.DistributedStreamIteratorTest.testLocallyForcedStream(DistributedStreamIteratorTest.java:297)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-7997) DistributedStreamIteratorTest.testLocallyForcedStream random failure
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7997?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-7997:
-------------------------------
Status: Open (was: New)
> DistributedStreamIteratorTest.testLocallyForcedStream random failure
> --------------------------------------------------------------------
>
> Key: ISPN-7997
> URL: https://issues.jboss.org/browse/ISPN-7997
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 9.1.0.Beta1
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
>
> The test uses the {{MagicKey(primary, backup...)}} constructor with only 16 segments and with the default {{SyncConsistentHashFactory}}. Since SCHF is based on the random addresses of the nodes, the combination of owners is not always possible:
> {noformat}
> testLocallyForcedStream[DIST_SYNC, tx=false](org.infinispan.stream.DistributedStreamIteratorTest) Time elapsed: 0.015 sec <<< FAILURE! java.lang.IllegalStateException: Could not find any segment owned by Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAM-5250, [Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678], primary segments: {1-3 5 10 14}, backup segments: {Cache 'org.infinispan.stream.DistributedStreamIteratorTest'@DistributedStreamIteratorTest[DIST_SYNC, tx=false]-NodeAL-48678={0 8-9 13}}
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:88)
> at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:137)
> at org.infinispan.stream.DistributedStreamIteratorTest.magicKey(DistributedStreamIteratorTest.java:324)
> at org.infinispan.stream.DistributedStreamIteratorTest.testLocallyForcedStream(DistributedStreamIteratorTest.java:297)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-7996) ClusterTopologyManagerTest.testAbruptLeaveAfterGetStatus2[SCATTERED_SYNC, tx=false] random failures
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-7996?page=com.atlassian.jira.plugin.... ]
Work on ISPN-7996 started by Radim Vansa.
-----------------------------------------
> ClusterTopologyManagerTest.testAbruptLeaveAfterGetStatus2[SCATTERED_SYNC, tx=false] random failures
> ---------------------------------------------------------------------------------------------------
>
> Key: ISPN-7996
> URL: https://issues.jboss.org/browse/ISPN-7996
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Reporter: Dan Berindei
> Assignee: Radim Vansa
> Priority: Critical
> Labels: testsuite_stability
> Attachments: ClusterTopologyManagerTest_master_20170628.log.gz
>
>
> The test first logs a few exceptions:
> {noformat}
> 23:16:53,126 ERROR (transport-thread-Test-NodeE-p55594-t1:[Topology-___defaultcache]) [LocalTopologyManagerImpl] ISPN000230: Failed to start rebalance for cache ___defaultcache
> java.lang.IllegalStateException: Segment 7 is in state OWNED
> at org.infinispan.scattered.impl.ScatteredVersionManagerImpl.registerSegment(ScatteredVersionManagerImpl.java:248) ~[classes/:?]
> at org.infinispan.scattered.impl.ScatteredStateConsumerImpl.beforeTopologyInstalled(ScatteredStateConsumerImpl.java:125) ~[classes/:?]
> at org.infinispan.statetransfer.StateConsumerImpl.onTopologyUpdate(StateConsumerImpl.java:336) ~[classes/:?]
> at org.infinispan.scattered.impl.ScatteredStateConsumerImpl.onTopologyUpdate(ScatteredStateConsumerImpl.java:98) ~[classes/:?]
> at org.infinispan.statetransfer.StateTransferManagerImpl.doTopologyUpdate(StateTransferManagerImpl.java:215) ~[classes/:?]
> at org.infinispan.statetransfer.StateTransferManagerImpl.access$000(StateTransferManagerImpl.java:53) ~[classes/:?]
> at org.infinispan.statetransfer.StateTransferManagerImpl$1.rebalance(StateTransferManagerImpl.java:138) ~[classes/:?]
> at org.infinispan.topology.LocalTopologyManagerImpl.doHandleRebalance(LocalTopologyManagerImpl.java:526) ~[classes/:?]
> at org.infinispan.topology.LocalTopologyManagerImpl.lambda$handleRebalance$3(LocalTopologyManagerImpl.java:486) ~[classes/:?]
> at org.infinispan.executors.LimitedExecutor.runTasks(LimitedExecutor.java:144) [classes/:?]
> {noformat}
> And then it times out:
> {noformat}
> 23:17:52,949 ERROR (testng-Test:[]) [TestingUtil] Timed out waiting for rebalancing to complete on node Test-NodeE-8881, expected member list is [Test-NodeE-8881], current member list is [Test-NodeE-8881, Test-NodeF-9273]!
> 23:17:52,949 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.statetransfer.ClusterTopologyManagerTest.testAbruptLeaveAfterGetStatus2[SCATTERED_SYNC, tx=false]
> java.lang.RuntimeException: Timed out waiting for rebalancing to complete on node Test-NodeE-8881, expected member list is [Test-NodeE-8881], current member list is [Test-NodeE-8881, Test-NodeF-9273]!
> at org.infinispan.test.TestingUtil.waitForNoRebalance(TestingUtil.java:383) ~[test-classes/:?]
> at org.infinispan.statetransfer.ClusterTopologyManagerTest.testAbruptLeaveAfterGetStatus2(ClusterTopologyManagerTest.java:433) ~[test-classes/:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months
[JBoss JIRA] (ISPN-8002) ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-8002?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-8002:
-------------------------------
Attachment: ScatteredStreamIteratorTest_ISPN-7998_ConsistentHash.getNumOwners_20170629.log.gz
> ScatteredStreamIteratorTest.waitUntilProcessingResults random failures
> ----------------------------------------------------------------------
>
> Key: ISPN-8002
> URL: https://issues.jboss.org/browse/ISPN-8002
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.1.0.CR1
> Reporter: Dan Berindei
> Assignee: Radim Vansa
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.1.0.Final
>
> Attachments: ScatteredStreamIteratorTest_ISPN-7998_ConsistentHash.getNumOwners_20170629.log.gz
>
>
> {noformat}
> 20:38:39,442 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.scattered.stream.ScatteredStreamIteratorTest.waitUntilProcessingResults[SCATTERED_SYNC, tx=false]
> java.lang.NullPointerException: null
> at org.infinispan.stream.DistributedStreamIteratorTest.waitUntilProcessingResults(DistributedStreamIteratorTest.java:207) ~[test-classes/:?]
> {noformat}
> Looks like segments {{ScatteredVersionManager}} blocks access to segments 10 and 12, and they are never suspected or retried:
> {noformat}
> 20:38:38,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-0 completed segments [6, 7, 13, 14, 15] with [] suspected segments
> 20:38:38,248 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 10, 11, 12] lost segments for Test-NodeBD-1062-0
> 20:38:38,249 TRACE (transport-thread-Test-NodeBD-p13301-t4:[Topology-org.infinispan.scattered.stream.Test]) [ScatteredVersionManager] Node Test-NodeBD-1062 blocks access to segment 10
> 20:38:38,253 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeBF-40292={8-9 11}} for id Test-NodeBD-1062-1
> 20:38:39,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-1 completed segments [] with [8, 9, 11] suspected segments
> 20:38:39,302 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 11] lost segments for Test-NodeBD-1062-1
> 20:38:39,420 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-2 completed segments [8, 9, 11] with [] suspected segments
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 2, 3, 4, 5]
> 20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[])
> {noformat}
> Please also add a {{toString()}} method in the stream commands, seeing the segments in the requests and responses would make it easier to follow the logs.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
6 years, 10 months