[JBoss JIRA] (ISPN-8202) cli.interpreter.SiteStatementTest random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-8202?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-8202:
---------------------------------
Assignee: Pedro Ruivo
> cli.interpreter.SiteStatementTest random failures
> -------------------------------------------------
>
> Key: ISPN-8202
> URL: https://issues.jboss.org/browse/ISPN-8202
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 9.1.0.Final
> Reporter: Gustavo Fernandes
> Assignee: Pedro Ruivo
> Labels: testsuite_stability
>
> {noformat}
> expected:<ok> but was:<Unable to pushState to 'NYC'. org.infinispan.commons.CacheException: Problems invoking command.>
> Stacktrace
> java.lang.AssertionError: expected:<ok> but was:<Unable to pushState to 'NYC'. org.infinispan.commons.CacheException: Problems invoking command.>
> at org.infinispan.cli.interpreter.SiteStatementTest.lambda$assertInterpreterOutput$7(SiteStatementTest.java:191)
> at org.infinispan.cli.interpreter.SiteStatementTest.assertInterpreterOutput(SiteStatementTest.java:198)
> at org.infinispan.cli.interpreter.SiteStatementTest.assertInterpreterOutput(SiteStatementTest.java:189)
> at org.infinispan.cli.interpreter.SiteStatementTest.testSiteStateTransfer(SiteStatementTest.java:78)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-5454) XSite: RetryMechanismTest random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-5454?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-5454:
---------------------------------
Assignee: Pedro Ruivo
> XSite: RetryMechanismTest random failures
> -----------------------------------------
>
> Key: ISPN-5454
> URL: https://issues.jboss.org/browse/ISPN-5454
> Project: Infinispan
> Issue Type: Bug
> Components: Cross-Site Replication
> Affects Versions: 7.2.1.Final
> Reporter: Dan Berindei
> Assignee: Pedro Ruivo
> Priority: Blocker
> Labels: testsuite_stability
> Fix For: 9.2.0.Final
>
>
> {{ClusteredCacheBackupReceiver.awaitRemoteTask()}} doesn't respect the state push command's timeout, at least when it's smaller than the sync replication timeout in the target cache. When that happens, the state provider will resend the state, and there will be 2 state push commands executing at the same time.
> RetryMechanismTest changes the state push timeout to 2 seconds, but the sync replication timeout stays at 15 seconds. This causes failures in {{testRetryLocally}} and {{testFailRetryLocally}}, if it takes more than 2 seconds to suspect the killed node.
> {noformat}
> 10:02:13,007 TRACE (asyncTransportThread-8,NodeN:) [RetryOnFailureXSiteCommand] Sending XSiteStatePushCommand{cacheName=___defaultcache, timeout=2000 (1 keys)} to [NYC (sync, timeout=2000)]
> 10:02:16,008 TRACE (asyncTransportThread-8,NodeN:) [RetryOnFailureXSiteCommand] Sending XSiteStatePushCommand{cacheName=___defaultcache, timeout=2000 (1 keys)} to [NYC (sync, timeout=2000)]
> 10:02:16,040 TRACE (asyncTransportThread-4,NodeP:) [RpcManagerImpl] replication exception:
> org.infinispan.remoting.transport.jgroups.SuspectException: Node NodeQ-56809 was suspected
> 10:02:16,040 TRACE (asyncTransportThread-0,NodeP:) [RpcManagerImpl] replication exception:
> org.infinispan.remoting.transport.jgroups.SuspectException: Node NodeQ-56809 was suspected
> 10:02:19,147 ERROR (testng-RetryMechanismTest:) [UnitTestTestNGListener] Test testFailRetryLocally(org.infinispan.xsite.statetransfer.failures.RetryMechanismTest) failed.
> java.lang.AssertionError: expected:<2> but was:<3>
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.failNotEquals(AssertJUnit.java:364)
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:80)
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:245)
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:252)
> at org.infinispan.xsite.statetransfer.failures.RetryMechanismTest.testFailRetryLocally(RetryMechanismTest.java:227)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-6827) ReplTotalOrderVersionedStateTransferTest.testStateTransfer random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-6827?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo commented on ISPN-6827:
-----------------------------------
There is a flaw in TOA.
It is possible to a node to receive a DATA message from a member that is no longer in the queue. Since the cleanup for leaving members is already done, this message stays in the queue forever in pending state. No other messages can be deliver. (Well, theoretically if a new view come, it will cleanup the message :))
> ReplTotalOrderVersionedStateTransferTest.testStateTransfer random failures
> ---------------------------------------------------------------------------
>
> Key: ISPN-6827
> URL: https://issues.jboss.org/browse/ISPN-6827
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 9.0.0.Alpha2
> Reporter: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.2.0.Final
>
> Attachments: ReplTotalOrderVersionedStateTransferTest_pr_rvansa_ISPN-5989_20160314.log.zip
>
>
> {noformat}
> java.lang.RuntimeException: Timed out waiting for rebalancing to complete on node ReplTotalOrderVersionedStateTransferTest-NodeB-17608, expected member list is [ReplTotalOrderVersionedStateTransferTest-NodeB-17608, ReplTotalOrderVersionedStateTransferTest-NodeC-39826], current member list is [ReplTotalOrderVersionedStateTransferTest-NodeA-54647, ReplTotalOrderVersionedStateTransferTest-NodeB-17608, ReplTotalOrderVersionedStateTransferTest-NodeC-39826]!
> at org.infinispan.test.TestingUtil.waitForRehashToComplete(TestingUtil.java:267)
> at org.infinispan.test.TestingUtil.waitForRehashToComplete(TestingUtil.java:277)
> at org.infinispan.container.versioning.VersionedReplStateTransferTest.testStateTransfer(VersionedReplStateTransferTest.java:74)
> {noformat}
> http://ci.infinispan.org/project.html?tab=testDetails&testNameId=-7264982...
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-8252) OngoingTransactionsAndJoinTest.testRehashOnJoin random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-8252?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-8252:
---------------------------------
Assignee: Pedro Ruivo
> OngoingTransactionsAndJoinTest.testRehashOnJoin random failures
> ---------------------------------------------------------------
>
> Key: ISPN-8252
> URL: https://issues.jboss.org/browse/ISPN-8252
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 9.1.0.Final
> Reporter: Tristan Tarrant
> Assignee: Pedro Ruivo
> Labels: testsuite_stability
>
> java.lang.AssertionError: Couldn't see key commit_during_rehash on joiner!
> at org.infinispan.distribution.rehash.OngoingTransactionsAndJoinTest.testRehashOnJoin(OngoingTransactionsAndJoinTest.java:118)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ... Removed 16 stack frames
>
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-6904) NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut fails
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-6904?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo commented on ISPN-6904:
-----------------------------------
*Possibly* the put is retried and it finds the new value already and returns it. However, the test expects a {{null}} return value.
> NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut fails
> -------------------------------------------------------------------
>
> Key: ISPN-6904
> URL: https://issues.jboss.org/browse/ISPN-6904
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.1.0.Final
> Reporter: Sebastian Łaskawiec
> Assignee: Pedro Ruivo
> Priority: Critical
> Labels: testsuite_stability
>
> http://ci.infinispan.org/viewLog.html?buildId=41289&tab=buildResultsDiv&b...
> {code}
> java.lang.AssertionError:
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
> at org.testng.AssertJUnit.assertNull(AssertJUnit.java:282)
> at org.testng.AssertJUnit.assertNull(AssertJUnit.java:274)
> at org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.doTest(NonTxPrimaryOwnerLeavingTest.java:114)
> at org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut(NonTxPrimaryOwnerLeavingTest.java:51)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
> at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
> at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
> at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
> at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
> at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
> at org.testng.TestRunner.privateRun(TestRunner.java:767)
> at org.testng.TestRunner.run(TestRunner.java:617)
> at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
> at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
> at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
> at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> ------- Stdout: -------
> [TestSuiteProgress] Test starting: org.infinispan.distribution.groups.GroupsDistAsyncFuncTest.testBasicDistribution
> [TestSuiteProgress] Test starting: org.infinispan.distribution.rehash.TxNonL1StateTransferOverwriteTest.testStateTransferInBetweenPrepareCommitMultipleEntryWithPutIfAbsent
> [TestSuiteProgress] Test starting: org.infinispan.distribution.groups.GroupsChFunctionalTest.testBasicDistribution
> [TestSuiteProgress] Test starting: org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut
> [TestSuiteProgress] Test starting: org.infinispan.distribution.groups.TransactionalGetGroupKeysTest.testGetKeyInGroupWithConcurrentActivation
> [TestSuiteProgress] Test failed: org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut
> 07:06:52,685 ERROR (testng-NonTxPrimaryOwnerLeavingTest) [TestSuiteProgress] Test failed: org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut
> java.lang.AssertionError:
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
> at org.testng.AssertJUnit.assertNull(AssertJUnit.java:282)
> at org.testng.AssertJUnit.assertNull(AssertJUnit.java:274)
> at org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.doTest(NonTxPrimaryOwnerLeavingTest.java:114)
> at org.infinispan.distribution.rehash.NonTxPrimaryOwnerLeavingTest.testPrimaryOwnerLeavingDuringPut(NonTxPrimaryOwnerLeavingTest.java:51)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[TestSuiteProgress] Tests succeeded: 129, failed: 1, skipped: 0
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-8253) InitiatorCrashOptimisticReplTest.testInitiatorCrashesBeforeReleasingLock
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-8253?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-8253:
---------------------------------
Assignee: Pedro Ruivo
> InitiatorCrashOptimisticReplTest.testInitiatorCrashesBeforeReleasingLock
> -------------------------------------------------------------------------
>
> Key: ISPN-8253
> URL: https://issues.jboss.org/browse/ISPN-8253
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 9.1.0.Final
> Reporter: Tristan Tarrant
> Assignee: Pedro Ruivo
> Labels: testsuite_stability
>
> java.lang.AssertionError: Expected key 'k' to be locked on cache 'Cache '___defaultcache'@InitiatorCrashOptimisticReplTest-NodeA-5100'
> at org.infinispan.test.AbstractCacheTest.assertLocked(AbstractCacheTest.java:77)
> at org.infinispan.lock.singlelock.replicated.optimistic.InitiatorCrashOptimisticReplTest.testInitiatorCrashesBeforeReleasingLock(InitiatorCrashOptimisticReplTest.java:68)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ... Removed 18 stack frames
>
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-7140) Concurrent modifications succeed in pessimistic cache
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-7140?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-7140:
---------------------------------
Assignee: Pedro Ruivo
> Concurrent modifications succeed in pessimistic cache
> -----------------------------------------------------
>
> Key: ISPN-7140
> URL: https://issues.jboss.org/browse/ISPN-7140
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.0.0.Alpha4
> Reporter: Radim Vansa
> Assignee: Pedro Ruivo
> Labels: consistency, testsuite_stability
> Attachments: log2.txt
>
>
> During node crash, two concurrent modifications in can both succeed in pessimistic tx cache.
> This also causes random failures in {{InfinispanNodeFailureTest}}:
> 1. TX1 originating on A acquires lock for key X, A is primary owner
> 2. C is killed and B becomes primary owner of key X
> 3. TX2 originating on B acquires lock for key X, B is now primary owner
> 4. TX1 commits the tx, Prepare is sent with the new topology id so it commits fine
> 5. TX2 also commits the transaction
> Log attached (this is not master but changes should not be related).
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-8257) BackupForStateTransferTest.testStateTransferWithClusterIdle random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-8257?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo commented on ISPN-8257:
-----------------------------------
* Possible cause:
Since the "{{finish state transfer}}" command is sent asynchronously to the receiver site, it is possible that the test thread will check the state before the command is received.
* Possible fix:
Change to {{assertEventuallyInSite()}} as in {{BaseStateTransferTest#assertEventuallyNoStateTransferInReceivingSite()}}
> BackupForStateTransferTest.testStateTransferWithClusterIdle random failures
> ---------------------------------------------------------------------------
>
> Key: ISPN-8257
> URL: https://issues.jboss.org/browse/ISPN-8257
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 9.1.0.Final
> Reporter: Galder Zamarreño
> Assignee: Pedro Ruivo
> Labels: testsuite_stability
>
> http://ci.infinispan.org/job/Infinispan/job/master/118/testReport/junit/o...
> {code}
> java.lang.AssertionError:
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest$6.assertInCache(BackupForStateTransferTest.java:138)
> at org.infinispan.xsite.AbstractXSiteTest.assertInSite(AbstractXSiteTest.java:178)
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest.assertNoStateTransferInReceivingSite(BackupForStateTransferTest.java:133)
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest.testStateTransferWithClusterIdle(BackupForStateTransferTest.java:94)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ... Removed 20 stack frames
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month
[JBoss JIRA] (ISPN-8257) BackupForStateTransferTest.testStateTransferWithClusterIdle random failures
by Pedro Ruivo (JIRA)
[ https://issues.jboss.org/browse/ISPN-8257?page=com.atlassian.jira.plugin.... ]
Pedro Ruivo reassigned ISPN-8257:
---------------------------------
Assignee: Pedro Ruivo
> BackupForStateTransferTest.testStateTransferWithClusterIdle random failures
> ---------------------------------------------------------------------------
>
> Key: ISPN-8257
> URL: https://issues.jboss.org/browse/ISPN-8257
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 9.1.0.Final
> Reporter: Galder Zamarreño
> Assignee: Pedro Ruivo
> Labels: testsuite_stability
>
> http://ci.infinispan.org/job/Infinispan/job/master/118/testReport/junit/o...
> {code}
> java.lang.AssertionError:
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest$6.assertInCache(BackupForStateTransferTest.java:138)
> at org.infinispan.xsite.AbstractXSiteTest.assertInSite(AbstractXSiteTest.java:178)
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest.assertNoStateTransferInReceivingSite(BackupForStateTransferTest.java:133)
> at org.infinispan.xsite.statetransfer.BackupForStateTransferTest.testStateTransferWithClusterIdle(BackupForStateTransferTest.java:94)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ... Removed 20 stack frames
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 1 month