[JBoss JIRA] (ISPN-6954) LiveRunningTest.liveRun fails
by Sebastian Łaskawiec (JIRA)
Sebastian Łaskawiec created ISPN-6954:
-----------------------------------------
Summary: LiveRunningTest.liveRun fails
Key: ISPN-6954
URL: https://issues.jboss.org/browse/ISPN-6954
Project: Infinispan
Issue Type: Bug
Components: Lucene Directory
Reporter: Sebastian Łaskawiec
Assignee: Sebastian Łaskawiec
Priority: Critical
http://ci.infinispan.org/project.html?buildTypeId=Infinispan_MasterHotspo...
{noformat}
org.infinispan.util.concurrent.TimeoutException: Replication timeout for infinispan-ci-slave-2-49844
at org.infinispan.remoting.transport.jgroups.JGroupsTransport.checkRsp(JGroupsTransport.java:820)
at org.infinispan.remoting.transport.jgroups.JGroupsTransport.lambda$invokeRemotelyAsync$302(JGroupsTransport.java:645)
at org.infinispan.remoting.transport.jgroups.JGroupsTransport$$Lambda$62/1069761118.apply(Unknown Source)
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1954)
at org.infinispan.remoting.transport.jgroups.SingleResponseFuture.call(SingleResponseFuture.java:46)
at org.infinispan.remoting.transport.jgroups.SingleResponseFuture.call(SingleResponseFuture.java:17)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
------- Stdout: -------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-43531, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-306, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-16763, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-22073, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-39174, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-6165, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-53391, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-44253, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-49844, cluster=ISPN
-------------------------------------------------------------------
-------------------------------------------------------------------
GMS: address=infinispan-ci-slave-2-17081, cluster=ISPN
-------------------------------------------------------------------
------- Stderr: -------
Exception in thread "Hibernate Search: async deletion of index segments-1" org.infinispan.util.concurrent.TimeoutException: Replication timeout for infinispan-ci-slave-2-17081
at org.infinispan.remoting.transport.jgroups.JGroupsTransport.checkRsp(JGroupsTransport.java:820)
at org.infinispan.remoting.transport.jgroups.JGroupsTransport.lambda$invokeRemotelyAsync$304(JGroupsTransport.java:660)
at org.infinispan.remoting.transport.jgroups.JGroupsTransport$$Lambda$74/1998174876.apply(Unknown Source)
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1954)
at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:47)
at org.infinispan.remoting.transport.jgroups.RspListFuture.call(RspListFuture.java:16)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months
[JBoss JIRA] (ISPN-6953) ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill fails
by Sebastian Łaskawiec (JIRA)
Sebastian Łaskawiec created ISPN-6953:
-----------------------------------------
Summary: ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill fails
Key: ISPN-6953
URL: https://issues.jboss.org/browse/ISPN-6953
Project: Infinispan
Issue Type: Bug
Components: Core
Reporter: Sebastian Łaskawiec
Assignee: Dan Berindei
Priority: Critical
http://ci.infinispan.org/project.html?projectId=Infinispan&testNameId=-18...
{noformat}
java.lang.AssertionError: expected:<ConsistentHashV2IntegrationTest-NodeA-61540> but was:<ConsistentHashV2IntegrationTest-NodeB-6324>
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.failNotEquals(AssertJUnit.java:364)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:80)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:88)
at org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.runTest(ConsistentHashV2IntegrationTest.java:123)
at org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill(ConsistentHashV2IntegrationTest.java:178)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
------- Stdout: -------
[TestSuiteProgress] Test failed: org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill
21:55:17,679 ERROR (testng-ConsistentHashV2IntegrationTest) [TestSuiteProgress] Test failed: org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill
java.lang.AssertionError: expected:<ConsistentHashV2IntegrationTest-NodeA-61540> but was:<ConsistentHashV2IntegrationTest-NodeB-6324>
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.failNotEquals(AssertJUnit.java:364)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:80)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:88)
at org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.runTest(ConsistentHashV2IntegrationTest.java:123)
at org.infinispan.client.hotrod.ConsistentHashV2IntegrationTest.testCorrectBalancingOfKeysAfterNodeKill(ConsistentHashV2IntegrationTest.java:178)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[TestSuiteProgress] Tests succeeded: 1537, failed: 1, skipped: 0
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months
[JBoss JIRA] (ISPN-6952) JCacheTwoCachesBasicOpsTest.testRemovedListener fails
by Sebastian Łaskawiec (JIRA)
Sebastian Łaskawiec created ISPN-6952:
-----------------------------------------
Summary: JCacheTwoCachesBasicOpsTest.testRemovedListener fails
Key: ISPN-6952
URL: https://issues.jboss.org/browse/ISPN-6952
Project: Infinispan
Issue Type: Bug
Components: JCache
Reporter: Sebastian Łaskawiec
Assignee: Galder Zamarreño
Priority: Critical
http://ci.infinispan.org/project.html?projectId=Infinispan&testNameId=804...
{noformat}
java.lang.AssertionError: expected [1] but found [2]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:494)
at org.testng.Assert.assertEquals(Assert.java:123)
at org.testng.Assert.assertEquals(Assert.java:370)
at org.testng.Assert.assertEquals(Assert.java:380)
at org.infinispan.jcache.AbstractTwoCachesBasicOpsTest.testRemovedListener(AbstractTwoCachesBasicOpsTest.java:302)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:343)
at org.testng.SuiteRunner.privateRun(SuiteRunner.java:305)
at org.testng.SuiteRunner.run(SuiteRunner.java:254)
at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
at org.testng.TestNG.run(TestNG.java:1057)
at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:115)
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeMulti(TestNGDirectoryTestSuite.java:205)
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:108)
at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:111)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
------- Stdout: -------
[TestSuiteProgress] Test starting: org.infinispan.jcache.JCacheTwoCachesBasicOpsTest.testRemovedListener
[TestSuiteProgress] Test failed: org.infinispan.jcache.JCacheTwoCachesBasicOpsTest.testRemovedListener
12:50:19,634 ERROR (testng-JCacheTwoCachesBasicOpsTest) [TestSuiteProgress] Test failed: org.infinispan.jcache.JCacheTwoCachesBasicOpsTest.testRemovedListener
java.lang.AssertionError: expected [1] but found [2]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:494)
at org.testng.Assert.assertEquals(Assert.java:123)
at org.testng.Assert.assertEquals(Assert.java:370)
at org.testng.Assert.assertEquals(Assert.java:380)
at org.infinispan.jcache.AbstractTwoCachesBasicOpsTest.testRemovedListener(AbstractTwoCachesBasicOpsTest.java:302)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[TestSuiteProgress] Tests succeeded: 19, failed: 1, skipped: 0
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months
[JBoss JIRA] (ISPN-6951) SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave fails
by Sebastian Łaskawiec (JIRA)
Sebastian Łaskawiec created ISPN-6951:
-----------------------------------------
Summary: SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave fails
Key: ISPN-6951
URL: https://issues.jboss.org/browse/ISPN-6951
Project: Infinispan
Issue Type: Bug
Components: Cross-Site Replication
Reporter: Sebastian Łaskawiec
Assignee: Pedro Ruivo
Priority: Critical
http://ci.infinispan.org/project.html?projectId=Infinispan&testNameId=289...
{noformat}
java.lang.AssertionError: expected:<ok> but was:<Unable to pushState to 'NYC'. org.infinispan.commons.CacheException: Problems invoking command.>
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:101)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:108)
at org.infinispan.xsite.statetransfer.failures.AbstractTopologyChangeTest.startStateTransfer(AbstractTopologyChangeTest.java:144)
at org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.doXSiteStateTransferDuringTopologyChange(SiteConsumerTopologyChangeTest.java:174)
at org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave(SiteConsumerTopologyChangeTest.java:59)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:348)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:38)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
------- Stdout: -------
[TestSuiteProgress] Test starting: org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave
[TestSuiteProgress] Test failed: org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave
22:43:18,511 ERROR (testng-SiteConsumerTopologyChangeTest) [TestSuiteProgress] Test failed: org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave
java.lang.AssertionError: expected:<ok> but was:<Unable to pushState to 'NYC'. org.infinispan.commons.CacheException: Problems invoking command.>
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:101)
at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:108)
at org.infinispan.xsite.statetransfer.failures.AbstractTopologyChangeTest.startStateTransfer(AbstractTopologyChangeTest.java:144)
at org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.doXSiteStateTransferDuringTopologyChange(SiteConsumerTopologyChangeTest.java:174)
at org.infinispan.xsite.statetransfer.failures.SiteConsumerTopologyChangeTest.testXSiteSTDuringLeave(SiteConsumerTopologyChangeTest.java:59)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)[TestSuiteProgress] Tests succeeded: 63, failed: 1, skipped: 0
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months
[JBoss JIRA] (ISPN-6925) Race condition in staggered gets
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-6925?page=com.atlassian.jira.plugin.... ]
Radim Vansa updated ISPN-6925:
------------------------------
Status: Pull Request Sent (was: Open)
Git Pull Request: https://github.com/infinispan/infinispan/pull/4486, https://github.com/infinispan/infinispan/pull/4512
Hi Paul, I've linked the PRs.
> Race condition in staggered gets
> --------------------------------
>
> Key: ISPN-6925
> URL: https://issues.jboss.org/browse/ISPN-6925
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.0.0.Alpha3, 8.2.3.Final
> Reporter: Radim Vansa
> Assignee: Radim Vansa
> Priority: Critical
> Attachments: server.log.node1, server.log.node2, server.log.node3
>
>
> There's a race condition in {{CommandAwareRpcDispatcher}}, as we do staggered gets. When the {{RspList}} is prepared, and then in {{processCallsStaggered$lambda}} the {{Rsp}} is filled in - both of them can set is as received but later see that the other response was not received yet, because there's no memory barrieri n between the {{setValue}}/{{setException}} and checking {{wasReceived}}.
> The race above happens when two responses come but none of them is accepted by the filter, but there's a second one in JGroupsTransport when the first response is accepted but then comes another one. In {{JGroupsTransport.invokeRemotelyAsync}} in the lambda handling {{rspListFuture.thenApply}} we may see another thread concurrently modifying the rsps; e.g. in {{checkRsp}} you find out that the concurrently written response was received and it's not an exception according to flags, but the value will be null, so you return null while you can have valid response in the other {{Rsp}}.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months
[JBoss JIRA] (ISPN-6925) Race condition in staggered gets
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-6925?page=com.atlassian.jira.plugin.... ]
Radim Vansa updated ISPN-6925:
------------------------------
Status: Open (was: New)
> Race condition in staggered gets
> --------------------------------
>
> Key: ISPN-6925
> URL: https://issues.jboss.org/browse/ISPN-6925
> Project: Infinispan
> Issue Type: Bug
> Components: Core
> Affects Versions: 9.0.0.Alpha3, 8.2.3.Final
> Reporter: Radim Vansa
> Assignee: Radim Vansa
> Priority: Critical
> Attachments: server.log.node1, server.log.node2, server.log.node3
>
>
> There's a race condition in {{CommandAwareRpcDispatcher}}, as we do staggered gets. When the {{RspList}} is prepared, and then in {{processCallsStaggered$lambda}} the {{Rsp}} is filled in - both of them can set is as received but later see that the other response was not received yet, because there's no memory barrieri n between the {{setValue}}/{{setException}} and checking {{wasReceived}}.
> The race above happens when two responses come but none of them is accepted by the filter, but there's a second one in JGroupsTransport when the first response is accepted but then comes another one. In {{JGroupsTransport.invokeRemotelyAsync}} in the lambda handling {{rspListFuture.thenApply}} we may see another thread concurrently modifying the rsps; e.g. in {{checkRsp}} you find out that the concurrently written response was received and it's not an exception according to flags, but the value will be null, so you return null while you can have valid response in the other {{Rsp}}.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 4 months