[JBoss JIRA] (ISPN-3443) WriteCommand may be ignored during state transfer
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/ISPN-3443?page=com.atlassian.jira.plugin.... ]
RH Bugzilla Integration commented on ISPN-3443:
-----------------------------------------------
Radim Vansa <rvansa(a)redhat.com> changed the Status of [bug 1001634|https://bugzilla.redhat.com/show_bug.cgi?id=1001634] from ON_QA to ASSIGNED
> WriteCommand may be ignored during state transfer
> -------------------------------------------------
>
> Key: ISPN-3443
> URL: https://issues.jboss.org/browse/ISPN-3443
> Project: Infinispan
> Issue Type: Bug
> Components: Locking and Concurrency, State transfer
> Affects Versions: 6.0.0.Alpha3
> Reporter: Radim Vansa
> Assignee: Dan Berindei
> Priority: Blocker
> Labels: jdg62blocker
> Fix For: 6.0.0.CR1
>
>
> Distributed sync non-tx cache.
> Situation:
> 1) A node is joining the cluster, requesting some segment
> 2) RemoveCommand is sent to backup owner with ignorePreviousValue=true
> 3) It looks up the entry and finds null
> 4) State transfer invokes the PutKeyValueCommand and sets the value for removed entry (updateKeys has not the key yet)
> 5) RemoveCommand adds its key to updateKeys set, but it does not remove the value as it is already null (in its context)
> Result: the value is removed on primary but on backup this is still present
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-2516) org.infinispan.distribution.topologyaware.TopologyAwareStateTransferTest.testNodeDown3 fails randomly
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/ISPN-2516?page=com.atlassian.jira.plugin.... ]
RH Bugzilla Integration commented on ISPN-2516:
-----------------------------------------------
Anna Manukyan <amanukya(a)redhat.com> made a comment on [bug 855350|https://bugzilla.redhat.com/show_bug.cgi?id=855350]
Hi,
the failure reappears on java16_default,w2k8r2 && x86_64 environment. The failure is:
Error Message
Timed out before caches had complete views. Expected 2 members in each view. Views are as follows: [[TopologyAwareStateTransferTest-NodeA-65287], [TopologyAwareStateTransferTest-NodeA-65287, TopologyAwareStateTransferTest-NodeB-35578, TopologyAwareStateTransferTest-NodeD-57223]]
Stacktrace
java.lang.RuntimeException: Timed out before caches had complete views. Expected 2 members in each view. Views are as follows: [[TopologyAwareStateTransferTest-NodeA-65287], [TopologyAwareStateTransferTest-NodeA-65287, TopologyAwareStateTransferTest-NodeB-35578, TopologyAwareStateTransferTest-NodeD-57223]]
at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:248)
at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:238)
at org.infinispan.test.TestingUtil.blockUntilViewsReceived(TestingUtil.java:333)
at org.infinispan.test.TestingUtil.blockUntilViewsReceived(TestingUtil.java:907)
at org.infinispan.distribution.topologyaware.TopologyAwareStateTransferTest.testNodeDown3(TopologyAwareStateTransferTest.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:715)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:907)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1237)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at org.testng.TestRunner.privateRun(TestRunner.java:767)
at org.testng.TestRunner.run(TestRunner.java:617)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:334)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:37)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:368)
at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Standard Output
[testng-TopologyAwareStateTransferTest] Test testNodeDown3(org.infinispan.distribution.topologyaware.TopologyAwareStateTransferTest) failed.
Test suite progress: tests succeeded: 1651, failed: 1, skipped: 0.
> org.infinispan.distribution.topologyaware.TopologyAwareStateTransferTest.testNodeDown3 fails randomly
> -----------------------------------------------------------------------------------------------------
>
> Key: ISPN-2516
> URL: https://issues.jboss.org/browse/ISPN-2516
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite
> Reporter: Anna Manukyan
> Assignee: Dan Berindei
> Labels: testsuite_stability
> Fix For: 5.3.0.Final
>
>
> The test fails randomly on Rhel6x64 IBM7JDk (for JDG testsuite).
> You can find the log here:
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
> The bug doesn't appear when the test is run separately.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-3443) WriteCommand may be ignored during state transfer
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-3443?page=com.atlassian.jira.plugin.... ]
Radim Vansa reopened ISPN-3443:
-------------------------------
I still have ignored commands - see comment I've posted 28/Aug/13 12:55 PM. Experienced with ReplaceCommand on backup owner in non-tx cache.
I believe the cause is race condition between checking the update keys in EntryWrappingInterceptor.commitEntryIfNeeded and actually committing it - if the ReplaceCommand is executed just between the check and committing the value, the value is overwritten by ST.
> WriteCommand may be ignored during state transfer
> -------------------------------------------------
>
> Key: ISPN-3443
> URL: https://issues.jboss.org/browse/ISPN-3443
> Project: Infinispan
> Issue Type: Bug
> Components: Locking and Concurrency, State transfer
> Affects Versions: 6.0.0.Alpha3
> Reporter: Radim Vansa
> Assignee: Dan Berindei
> Priority: Blocker
> Labels: jdg62blocker
> Fix For: 6.0.0.CR1
>
>
> Distributed sync non-tx cache.
> Situation:
> 1) A node is joining the cluster, requesting some segment
> 2) RemoveCommand is sent to backup owner with ignorePreviousValue=true
> 3) It looks up the entry and finds null
> 4) State transfer invokes the PutKeyValueCommand and sets the value for removed entry (updateKeys has not the key yet)
> 5) RemoveCommand adds its key to updateKeys set, but it does not remove the value as it is already null (in its context)
> Result: the value is removed on primary but on backup this is still present
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-3554) Tests from org.infinispan.persistence package fail on different environments
by Anna Manukyan (JIRA)
[ https://issues.jboss.org/browse/ISPN-3554?page=com.atlassian.jira.plugin.... ]
Anna Manukyan updated ISPN-3554:
--------------------------------
Summary: Tests from org.infinispan.persistence package fail on different environments (was: Tests from org.infinispan.persistence package fail on Solaris)
> Tests from org.infinispan.persistence package fail on different environments
> ----------------------------------------------------------------------------
>
> Key: ISPN-3554
> URL: https://issues.jboss.org/browse/ISPN-3554
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 6.0.0.Beta1
> Environment: Solaris{10,11}, Solaris Sparc{10, 11}, Windows{2008R2, 2012} && jdk6, RHEL{5, 6} && {x86_64, x64} && jdk6
> Reporter: Vitalii Chepeliuk
> Assignee: Mircea Markus
> Labels: testsuite_stability
> Attachments: infinispan.log.zip
>
>
> Following 4 tests fails
> org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
> You can see failing result from our jenkins
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
> Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
> Yet another thing about these tests. Very often the testsuite hangs on the tests for LocalModePassivationTest. The last test that is executed is: testSizeWithEvictedEntries(org.infinispan.persistence.LocalModePassivationTest) and the testsuite hangs on the execution of testSizeWithEvictedEntriesAndFlags(org.infinispan.persistence.LocalModePassivationTest). Unfortunatelly at the moment I cannot provide any logs, as the job abort doesn't do the thread dump of the java process. As soon as I'll succeed in the log retrieval, I'll attach also these logs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-3554) Tests from org.infinispan.persistence package fail on Solaris
by Anna Manukyan (JIRA)
[ https://issues.jboss.org/browse/ISPN-3554?page=com.atlassian.jira.plugin.... ]
Anna Manukyan updated ISPN-3554:
--------------------------------
Description:
Following 4 tests fails
org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
You can see failing result from our jenkins
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
Yet another thing about these tests. Very often the testsuite hangs on the tests for LocalModePassivationTest. The last test that is executed is: testSizeWithEvictedEntries(org.infinispan.persistence.LocalModePassivationTest) and the testsuite hangs on the execution of testSizeWithEvictedEntriesAndFlags(org.infinispan.persistence.LocalModePassivationTest). Unfortunatelly at the moment I cannot provide any logs, as the job abort doesn't do the thread dump of the java process. As soon as I'll succeed in the log retrieval, I'll attach also these logs.
was:
Following 4 tests fails
org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
You can see failing result from our jenkins
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
> Tests from org.infinispan.persistence package fail on Solaris
> -------------------------------------------------------------
>
> Key: ISPN-3554
> URL: https://issues.jboss.org/browse/ISPN-3554
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 6.0.0.Beta1
> Environment: Solaris{10,11}, Solaris Sparc{10, 11}, Windows{2008R2, 2012} && jdk6, RHEL{5, 6} && {x86_64, x64} && jdk6
> Reporter: Vitalii Chepeliuk
> Assignee: Mircea Markus
> Labels: testsuite_stability
> Attachments: infinispan.log.zip
>
>
> Following 4 tests fails
> org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
> You can see failing result from our jenkins
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
> Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
> Yet another thing about these tests. Very often the testsuite hangs on the tests for LocalModePassivationTest. The last test that is executed is: testSizeWithEvictedEntries(org.infinispan.persistence.LocalModePassivationTest) and the testsuite hangs on the execution of testSizeWithEvictedEntriesAndFlags(org.infinispan.persistence.LocalModePassivationTest). Unfortunatelly at the moment I cannot provide any logs, as the job abort doesn't do the thread dump of the java process. As soon as I'll succeed in the log retrieval, I'll attach also these logs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-3554) Tests from org.infinispan.persistence package fail on Solaris
by Anna Manukyan (JIRA)
[ https://issues.jboss.org/browse/ISPN-3554?page=com.atlassian.jira.plugin.... ]
Anna Manukyan updated ISPN-3554:
--------------------------------
Attachment: infinispan.log.zip
infinispan log for core module is attached for detailed logs.
> Tests from org.infinispan.persistence package fail on Solaris
> -------------------------------------------------------------
>
> Key: ISPN-3554
> URL: https://issues.jboss.org/browse/ISPN-3554
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 6.0.0.Beta1
> Environment: Solaris{10,11}, Solaris Sparc{10, 11}, Windows{2008R2, 2012} && jdk6, RHEL{5, 6} && {x86_64, x64} && jdk6
> Reporter: Vitalii Chepeliuk
> Assignee: Mircea Markus
> Labels: testsuite_stability
> Attachments: infinispan.log.zip
>
>
> Following 4 tests fails
> org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
> You can see failing result from our jenkins
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
> Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months
[JBoss JIRA] (ISPN-3554) Tests from org.infinispan.persistence package fail on Solaris
by Anna Manukyan (JIRA)
[ https://issues.jboss.org/browse/ISPN-3554?page=com.atlassian.jira.plugin.... ]
Anna Manukyan updated ISPN-3554:
--------------------------------
Description:
Following 4 tests fails
org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
You can see failing result from our jenkins
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
was:
Following 4 tests fails
org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
You can see failing result from our jenkins
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
> Tests from org.infinispan.persistence package fail on Solaris
> -------------------------------------------------------------
>
> Key: ISPN-3554
> URL: https://issues.jboss.org/browse/ISPN-3554
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 6.0.0.Beta1
> Environment: Solaris{10,11}, Solaris Sparc{10, 11}, Windows{2008R2, 2012} && jdk6, RHEL{5, 6} && {x86_64, x64} && jdk6
> Reporter: Vitalii Chepeliuk
> Assignee: Mircea Markus
> Labels: testsuite_stability
>
> Following 4 tests fails
> org.infinispan.persistence.LocalModeNoPassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModeNoPassivationTest.testValuesWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testEntrySetWithEvictedEntries
> org.infinispan.persistence.LocalModePassivationTest.testValuesWithEvictedEntries
> You can see failing result from our jenkins
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...
> Please note, that the following test is also failing very often org.infinispan.persistence.remote.RemoteStoreTest.testLoadAndStoreWithLifespanAndIdle. Here the failure is mostly on Windows machines with JDK6. You can find the logs here:
> http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/edg-60-ispn-testsuite...
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 6 months