[JBoss JIRA] (ISPN-4546) Possible stale lock when the primary owner leaves during rebalance
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/ISPN-4546?page=com.atlassian.jira.plugin.... ]
RH Bugzilla Integration commented on ISPN-4546:
-----------------------------------------------
Radovan STANCEL <rstancel(a)redhat.com> changed the Status of [bug 1385162|https://bugzilla.redhat.com/show_bug.cgi?id=1385162] from ASSIGNED to POST
> Possible stale lock when the primary owner leaves during rebalance
> ------------------------------------------------------------------
>
> Key: ISPN-4546
> URL: https://issues.jboss.org/browse/ISPN-4546
> Project: Infinispan
> Issue Type: Bug
> Components: Core, State Transfer
> Affects Versions: 7.0.0.Alpha5, 7.1.1.Final
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Fix For: 7.2.0.Final
>
>
> Topology T: coordinator = A, owners(k) = [C, D], pending_owners(k) = null
> B sends prepareCommand(tx1, put(k, v)) to C, D
> D adds backup locks and replies
> C acquires lock, ready to send reply to B
> A starts installing topology T+1: owners(k) = [C, D], pending_owners(k) = [C, E]
> A, C and E install topology T+1, B and D do not
> E requests and receives tx data from C, including tx1
> C leaves
> B sees a SuspectException, sends rollbackCommand(tx1) to C, D
> D removes tx1
> C has left, but is ignored
> B reports to the user that the tx has been rolled back
> B and D install topology T+1 (optional)
> A starts installing topology T+2: owners(k) = [D], pending_owners(k) = [E]
> A, B, D, E all install topology T+2
> E requests and receives state from D, but it does not remove tx1
> A starts installing topology T+3: owners(k) = [E], pending_owners(k) = null
> E now has a stale backup lock on k
> It seems very hard to reproduce in production: C would have to leave soon enough so that B and D haven't received the T+1 topology yet, but late enough for it to send its transaction data to E.
> A possible solution would be to catch any SuspectException during prepare/commit/rollback (without ignoring leavers), wait for a new topology, and replicate the command again on the new owners. Obviously, this wouldn't work with asynchronous prepare/commit/rollback.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-7181) RocksDB cache store fails when using embedded uber jar
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7181?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7181:
--------------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
> RocksDB cache store fails when using embedded uber jar
> ------------------------------------------------------
>
> Key: ISPN-7181
> URL: https://issues.jboss.org/browse/ISPN-7181
> Project: Infinispan
> Issue Type: Bug
> Components: Build process
> Reporter: Vojtech Juranek
> Assignee: Vojtech Juranek
> Fix For: 9.0.0.Beta1, 9.0.0.Final
>
>
> When app uses depends on ISPN embedded user jar and has configured RocksDB cache store, it fails with
> {noformat}
> Caused by: java.lang.NoClassDefFoundError: org/rocksdb/RocksDBException
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
> at java.lang.Class.privateGetPublicMethods(Class.java:2902)
> at java.lang.Class.getMethods(Class.java:1615)
> at org.infinispan.commons.util.Util.getFactoryMethod(Util.java:220)
> at org.infinispan.commons.util.Util.getInstanceStrict(Util.java:259)
> at org.infinispan.commons.util.Util.getInstance(Util.java:238)
> at org.infinispan.persistence.factory.LocalClassLoaderCacheStoreFactory.createInstance(LocalClassLoaderCacheStoreFactory.java:25)
> at org.infinispan.persistence.factory.CacheStoreFactoryRegistry.createInstance(CacheStoreFactoryRegistry.java:39)
> at org.infinispan.persistence.manager.PersistenceManagerImpl.createLoadersAndWriters(PersistenceManagerImpl.java:590)
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:146)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:168)
> ... 11 more
> Caused by: java.lang.ClassNotFoundException: org.rocksdb.RocksDBException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 27 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-7161) RemoteGetFailureTest.testOneOwnerSuspectedNoFilter[staggered=false] random failures
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7161?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7161:
--------------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
> RemoteGetFailureTest.testOneOwnerSuspectedNoFilter[staggered=false] random failures
> -----------------------------------------------------------------------------------
>
> Key: ISPN-7161
> URL: https://issues.jboss.org/browse/ISPN-7161
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.0.0.Beta1
>
>
> {noformat}
> java.lang.AssertionError:
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:33)
> at org.infinispan.distribution.RemoteGetFailureTest.testOneOwnerSuspectedNoFilter(RemoteGetFailureTest.java:223)
> {noformat}
> The test installs a new view and then immediately unblocks the latch on node 1. Since ISPN-5469, {{RequestCorrelator}} doesn't receive the view synchronously any more, so node 0 could receive the response from node 1 before receiving the view and suspecting node 2.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-7181) RocksDB cache store fails when using embedded uber jar
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7181?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7181:
--------------------------------------
Fix Version/s: 9.0.0.Beta1
9.0.0.Final
> RocksDB cache store fails when using embedded uber jar
> ------------------------------------------------------
>
> Key: ISPN-7181
> URL: https://issues.jboss.org/browse/ISPN-7181
> Project: Infinispan
> Issue Type: Bug
> Components: Build process
> Reporter: Vojtech Juranek
> Assignee: Vojtech Juranek
> Fix For: 9.0.0.Beta1, 9.0.0.Final
>
>
> When app uses depends on ISPN embedded user jar and has configured RocksDB cache store, it fails with
> {noformat}
> Caused by: java.lang.NoClassDefFoundError: org/rocksdb/RocksDBException
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
> at java.lang.Class.privateGetPublicMethods(Class.java:2902)
> at java.lang.Class.getMethods(Class.java:1615)
> at org.infinispan.commons.util.Util.getFactoryMethod(Util.java:220)
> at org.infinispan.commons.util.Util.getInstanceStrict(Util.java:259)
> at org.infinispan.commons.util.Util.getInstance(Util.java:238)
> at org.infinispan.persistence.factory.LocalClassLoaderCacheStoreFactory.createInstance(LocalClassLoaderCacheStoreFactory.java:25)
> at org.infinispan.persistence.factory.CacheStoreFactoryRegistry.createInstance(CacheStoreFactoryRegistry.java:39)
> at org.infinispan.persistence.manager.PersistenceManagerImpl.createLoadersAndWriters(PersistenceManagerImpl.java:590)
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:146)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:168)
> ... 11 more
> Caused by: java.lang.ClassNotFoundException: org.rocksdb.RocksDBException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 27 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months