TEST_PING on a Mac?
by Manik Surtani
Guys - has anyone seen this? Happens on many tests when I run on OSX, but works fine on Linux.
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running TestSuite
Transaction manager used: JBossTM
Transport protocol stack used = tcp
2011-09-26 18:19:25,724 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:19:33,241 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:19:40,753 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:19:48,267 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:19:55,784 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:03,316 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:11,156 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:19,298 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:26,833 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:34,347 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:41,859 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:49,366 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:20:56,884 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:21:04,416 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
2011-09-26 18:21:12,249 WARN [GMS] (testng-TxAndInvalidationTimeoutTest) join(TxAndInvalidationTimeoutTest-NodeB-47469) sent to TxAndInvalidationTimeoutTest-NodeA-11323 timed out (after 7000 ms), retrying
--
Manik Surtani
manik(a)jboss.org
twitter.com/maniksurtani
Lead, Infinispan
http://www.infinispan.org
12 years, 7 months
tests failing
by Sanne Grinovero
Hi all,
I'm again having many tests failing on infinispan / core.
I've been looking at pull requests but I'm not going to push anything
up to master without being able to test.
Am I the only one having so many issues?
Sanne
=====
details:
Out of several runs, this one was the best resulting so far:
Tests run: 1375, Failures: 132, Errors: 0, Skipped: 26, Time elapsed:
532.485 sec <<< FAILURE!
Results :
Failed tests:
testReplicateJBossExternalizePojo(org.infinispan.marshall.MarshallExternalPojosTest)
testReplicateMarshallableByPojo(org.infinispan.marshall.MarshallExternalPojosTest)
testNonTransactional(org.infinispan.distribution.rehash.ConcurrentOverlappingLeaveTest)
testRemoveCacheClusteredLocalStores(org.infinispan.manager.CacheManagerTest)
setUpTx(org.infinispan.tx.recovery.admin.CommitFailsTest)
testJoinComplete(org.infinispan.distribution.rehash.RehashCompletedOnJoinTest)
testRemoveCacheClusteredSharedStores(org.infinispan.manager.CacheManagerTest)
testRemoveCacheLocal(org.infinispan.manager.CacheManagerTest)
testNonTransactional(org.infinispan.distribution.rehash.ConcurrentNonOverlappingLeaveTest)
testAsyncMethods(org.infinispan.replication.AsyncAPISyncReplTest)
testAsyncTxMethods(org.infinispan.replication.AsyncAPISyncReplTest)
testCorrectFunctionalityOnConditionalWrite(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testTransactional(org.infinispan.distribution.rehash.ConcurrentOverlappingLeaveTest)
testInvalidationBehaviorOnRehash(org.infinispan.distribution.rehash.L1OnRehashTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testTransactional(org.infinispan.distribution.rehash.ConcurrentNonOverlappingLeaveTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testScenario(org.infinispan.distribution.IllegalMonitorTest)
testForFailure(org.infinispan.statetransfer.StateTransferLargeObjectTest)
testCorrectFunctionalityOnUnconditionalWrite(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testRemoteGet(org.infinispan.distribution.RemoteGetTest)
testSkipLookupOnAsyncRemove(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testBasicDistributedCallable(org.infinispan.distexec.DistributedExecutorTest)
testSkipLookupOnGet(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testSkipLookupOnGetWhileBatching(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testSkipLookupOnRemove(org.infinispan.distribution.DistSkipRemoteLookupWithoutL1Test)
testConcurrentStateTransfer(org.infinispan.statetransfer.StateTransferFileCacheLoaderFunctionalTest)
testInvalidationBehaviorOnRehash(org.infinispan.distribution.rehash.L1OnRehashL1DisabledTest)
testAsyncMethods(org.infinispan.invalidation.AsyncAPISyncInvalTest)
testAsyncGetCleansContextFlags(org.infinispan.distribution.DistSyncCacheStoreNotSharedTest)
testConcurrentHashMap(org.infinispan.marshall.VersionAwareMarshallerTest)
testErrorUnmarshalling(org.infinispan.marshall.VersionAwareMarshallerTest)
testExceptionResponse(org.infinispan.marshall.VersionAwareMarshallerTest)
testMIMECacheEntryMarshalling(org.infinispan.marshall.VersionAwareMarshallerTest)
testMarshallObjectThatContainsACustomReadObjectMethod(org.infinispan.marshall.VersionAwareMarshallerTest)
testMarshallingNestedSerializableSubclass(org.infinispan.marshall.VersionAwareMarshallerTest)
testMarshallingSerializableSubclass(org.infinispan.marshall.VersionAwareMarshallerTest)
testPojoWithJBossMarshallingExternalizer(org.infinispan.marshall.VersionAwareMarshallerTest)
testSingleCacheExecution(org.infinispan.distexec.BasicDistributedExecutorTest)
testAsyncForce(org.infinispan.api.mvcc.PutForExternalReadTest)
testThrowErrorFromRemoteInterceptor(org.infinispan.remoting.TransportSenderExceptionHandlingTest)
testThrowErrorFromRemoteListener(org.infinispan.remoting.TransportSenderExceptionHandlingTest)
testThrowExceptionFromRemoteInterceptor(org.infinispan.remoting.TransportSenderExceptionHandlingTest)
testThrowExceptionFromRemoteListener(org.infinispan.remoting.TransportSenderExceptionHandlingTest)
testNonTransactional(org.infinispan.distribution.rehash.ConcurrentJoinTest)
testTransactional(org.infinispan.distribution.rehash.ConcurrentJoinTest)
setUpTx(org.infinispan.tx.recovery.admin.CommitFailsReplicatedTest)
testAsyncMethods(org.infinispan.replication.AsyncAPIAsyncReplTest)
testAsyncMethods(org.infinispan.invalidation.AsyncAPIAsyncInvalTest)
testConcurrentStateTransfer(org.infinispan.statetransfer.StateTransferFunctionalTest)
testInitialStateTransferInDifferentThread(org.infinispan.statetransfer.StateTransferFileCacheLoaderFunctionalTest)
testPutAllTimeoutsInTx(org.infinispan.tx.exception.TxAndInvalidationTimeoutTest)
testPutTimeoutsInTx(org.infinispan.tx.exception.TxAndInvalidationTimeoutTest)
testRemoveTimeoutsInTx(org.infinispan.tx.exception.TxAndInvalidationTimeoutTest)
testAsyncTxMethods(org.infinispan.replication.AsyncAPIAsyncReplTest)
testNonTransactional(org.infinispan.distribution.rehash.SingleLeaveTest)
testTransactional(org.infinispan.distribution.rehash.SingleLeaveTest)
testInvalidationBehaviorOnRehash(org.infinispan.distribution.rehash.L1OnRehashDisabledTest)
testNonTransactional(org.infinispan.distribution.rehash.SingleJoinTest)
testDisjointSetTransaction(org.infinispan.distribution.DistCacheStoreTxDisjointSetTest)
testTransactional(org.infinispan.distribution.rehash.SingleJoinTest)
testBookSearch(org.infinispan.distexec.mapreduce.BookSearchTest)
testMultipleReplicationCommit(org.infinispan.atomic.ClusteredAPITest)
testReplicationCommit(org.infinispan.atomic.ClusteredAPITest)
testReplicationCommitCreateMapInTransaction(org.infinispan.atomic.ClusteredAPITest)
testReplicationRollback(org.infinispan.atomic.ClusteredAPITest)
testSTWithThirdWritingNonTxCache(org.infinispan.statetransfer.StateTransferFunctionalTest)
testLockAndGet(org.infinispan.tx.synchronisation.APIDistWithSyncTest)
testLockAndGetAndPut(org.infinispan.tx.synchronisation.APIDistWithSyncTest)
testLockAndPutRetval(org.infinispan.tx.synchronisation.APIDistWithSyncTest)
testLockAndRemoveRetval(org.infinispan.tx.synchronisation.APIDistWithSyncTest)
testThrowErrorFromRemoteInterceptor(org.infinispan.remoting.RemoteExceptionHandlingWithStateTransferTest)
testThrowErrorFromRemoteListener(org.infinispan.remoting.RemoteExceptionHandlingWithStateTransferTest)
testThrowExceptionFromRemoteInterceptor(org.infinispan.remoting.RemoteExceptionHandlingWithStateTransferTest)
testThrowExceptionFromRemoteListener(org.infinispan.remoting.RemoteExceptionHandlingWithStateTransferTest)
testRecoveryInfoListCommit(org.infinispan.tx.recovery.admin.InDoubtWithCommitFailsTest)
testCorrectFunctionalityOnConditionalWrite(org.infinispan.distribution.DistSkipRemoteLookupTest)
testAsyncMethods(org.infinispan.distribution.AsyncAPIAsyncDistTest)
testCorrectFunctionalityOnUnconditionalWrite(org.infinispan.distribution.DistSkipRemoteLookupTest)
testSkipLookupOnAsyncRemove(org.infinispan.distribution.DistSkipRemoteLookupTest)
testSkipLookupOnGet(org.infinispan.distribution.DistSkipRemoteLookupTest)
testRestoreTransactionalAtomicMap(org.infinispan.loaders.file.ClusterFileCacheStoreFunctionalTest)
testSkipLookupOnGetWhileBatching(org.infinispan.distribution.DistSkipRemoteLookupTest)
testSkipLookupOnRemove(org.infinispan.distribution.DistSkipRemoteLookupTest)
testErrorWhenRetrievingKeyFromNonOwner(org.infinispan.distribution.SingleOwnerTest)
testRetrieveNonSerializableKeyFromNonOwner(org.infinispan.distribution.SingleOwnerTest)
testAddIntFieldDiffIspnExternalizer(org.infinispan.marshall.multiversion.MultiPojoVersionMarshallTest)
testAddStringFieldDiffIspnExternalizer(org.infinispan.marshall.multiversion.MultiPojoVersionMarshallTest)
testRemoveFieldIspnExternalizer(org.infinispan.marshall.multiversion.MultiPojoVersionMarshallTest)
testSequence3(org.infinispan.distribution.ConcurrentStartWithReplTest)
testSequence4(org.infinispan.distribution.ConcurrentStartWithReplTest)
testAsyncMethods(org.infinispan.distribution.AsyncAPISyncDistTest)
testAsyncTxMethods(org.infinispan.distribution.AsyncAPISyncDistTest)
createBeforeClass(org.infinispan.replication.ReplicationExceptionTest)
testDeleteNonExistentEntry(org.infinispan.invalidation.SyncInvalidationTest)
testPutForExternalRead(org.infinispan.invalidation.SyncInvalidationTest)
testSTWithThirdWritingTxCache(org.infinispan.statetransfer.StateTransferFunctionalTest)
testTxSyncUnableToInvalidate(org.infinispan.invalidation.SyncInvalidationTest)
testLockAndGet(org.infinispan.lock.APIDistTest)
testLockAndGetAndPut(org.infinispan.lock.APIDistTest)
testLockAndPutRetval(org.infinispan.lock.APIDistTest)
testLockAndRemoveRetval(org.infinispan.lock.APIDistTest)
testDeleteNonExistentEntry(org.infinispan.invalidation.AsyncInvalidationTest)
testPutForExternalRead(org.infinispan.invalidation.AsyncInvalidationTest)
testSTWithWritingNonTxThread(org.infinispan.statetransfer.StateTransferFunctionalTest)
testRecoveryInfoListRollback(org.infinispan.tx.recovery.admin.InDoubtWithCommitFailsTest)
testConcurrentStateTransfer(org.infinispan.statetransfer.StateTransferCacheLoaderFunctionalTest)
testTxSyncUnableToInvalidate(org.infinispan.invalidation.AsyncInvalidationTest)
testSTWithWritingTxThread(org.infinispan.statetransfer.StateTransferFunctionalTest)
testSTWithThirdWritingNonTxCache(org.infinispan.statetransfer.StateTransferCacheLoaderFunctionalTest)
testAsyncTxMethods(org.infinispan.distribution.AsyncAPIAsyncDistTest)
testSTWithThirdWritingTxCache(org.infinispan.statetransfer.StateTransferCacheLoaderFunctionalTest)
testSTWithWritingNonTxThread(org.infinispan.statetransfer.StateTransferCacheLoaderFunctionalTest)
testSTWithWritingTxThread(org.infinispan.statetransfer.StateTransferCacheLoaderFunctionalTest)
Tests run: 1375, Failures: 132, Errors: 0, Skipped: 26
12 years, 7 months
Request for feedback on cache store support in AS7 Infinispan subsystem
by Paul Ferraro
Hi all,
In AS 7.0, only the those cache store implementations packaged in
infinispan-core were usable by default. While the Infinispan subsystem
schema allowed users to use any cache store implementation (via <store
class="..."/>), they need to manually add the relevant jars to the
org.infinispan module, and update the module.xml file accordingly so
that the subsystem's module classloader is aware of these cache store
classes.
To simplify the use of other common cache store implementations, I'm in
the process of working on the following jira, which aims to include the
jdbc, remote, and cloud cache store jars in the org.infinispan module by
default:
https://issues.jboss.org/browse/AS7-1713
As well as including the relevant jars, we would also like to simplify
their definition (like we did for <file-store/>, such that users don't
need to specify class names, provide as many sensible defaults as
possible, and take care of any required service dependencies.
I've created a draft of what I thought could be workable schema for the
remote and jdbc cache stores and would like some feedback.
The amended Infinispan subsystem schema can be found here:
https://github.com/pferraro/jboss-as/blob/master/build/src/main/resources...
For the jdbc cache stores, which come in 3 flavors, I've consolidated
them into a single configuration element <jdbc-store/>, where the
variant is implied the defined tables. After providing default values
for all the required fields, we arrive at the following minimal
configuration:
e.g.
<jdbc-store datasource="java:jboss/jdbc/somedatabase"/>
I started with the assumption that the database resource will always
come from an AS-managed DataSource.
To use a string-based jdbc store, we specify the type of table to use:
e.g.
<jdbc-store datasource="java:jboss/jdbc/somedatabase">
<entry-table/>
</jdbc-store>
Likewise, if we want to use a binary jdbc store:
e.g.
<jdbc-store datasource="java:jboss/jdbc/somedatabase">
<bucket-table/>
</jdbc-store>
Using both <entry-table/> and <bucket-table/> (or neither) indicates the
use of a mixed jdbc store.
The tables themselves are fully customizable (shown with their default
values):
e.g.
<jdbc-store datasource="java:jboss/jdbc/somedatabase">
<bucket-table prefix="ispn_bucket" batch-size="100" fetch-size="100">
<id-column name="id" type="VARCHAR"/>
<data-column name="datum" type="BINARY"/>
<timestamp-column name="version" type="BIGINT"/>
</bucket-table>
<entry-table prefix="ispn_entry" batch-size="100" fetch-size="100">
<id-column name="id" type="VARCHAR"/>
<data-column name="datum" type="BINARY"/>
<timestamp-column name="version" type="BIGINT"/>
</entry-table>
</jdbc-store>
The schema for the remote cache store is far simpler. You can specify a
specific remote cache name, server list, and hot rod client properties
are directly enumerated:
e.g.
<remote-store cache="some-named-cache" servers="127.0.0.1:11311">
<property name="infinispan.client.hotrod.request_balancing_strategy">...</property>
</remote-store>
If the cache attribute is omitted, we assume the default cache is to be
used.
Unfortunately, there doesn't seem to be a way to integrate the thread
pools used by RemoteCache/RemoteCacheManager with the AS7 threading
subsystem. In order to do this, RemoteCacheStoreConfig would need
methods for providing ExecutorFactory implementations, similar to the
way GlobalConfiguration works.
I haven't started on the cloud-based store yet, as it's kind of a
dependency nightmare.
Thoughts?
Paul
12 years, 7 months
Versioned entries - overview of design, looking for comments
by Manik Surtani
So I've been hacking on versioned entries for a bit now, and want to run the designs by everyone. Adding an EntryVersion to each entry is easy, making this optional and null by default easy too, and a SimpleVersion a wrapper around a long and a PartitionTolerantVersion being a vector clock implementation. Also easy stuff, changing the entry hierarchy and the marshalling to ensure versions - if available - are shipped, etc.
Comparing versions would happen in Mircea's optimistic locking code, on prepare, when a write skew check is done. If running in a non-clustered environment, the simple object-identity check we currently have is enough; otherwise an EntryVersion.compare() will need to happen, with one of 4 possible results: equal, newer than, older than, or concurrently modified. The last one can only happen if you have a PartitionTolerantVersion, and will indicate a split brain and simultaneous update.
Now the hard part. Who increments the version? We have a few options, all seem expensive.
1) The modifying node. If the modifying node is a data owner, then easy. Otherwise the modifying node *has* to do a remote GET first (or at least a GET_VERSION) before doing a PUT. Extra RPC per entry. Sucks.
2) The data owner. This would have to happen on the primary data owner only, and the primary data owner would need to perform the write skew check. NOT the modifying node. The modifying node would also need to increment and ship its own NodeClock along with the modification. Extra info to ship per commit.
I'm guessing we go with #2, but would like to hear your thoughts.
Cheers
Manik
--
Manik Surtani
manik(a)jboss.org
twitter.com/maniksurtani
Lead, Infinispan
http://www.infinispan.org
12 years, 7 months
5.1.0.ALPHA2
by Galder Zamarreño
Hi,
5.1.0.ALPHA2 is scheduled for Monday, 19th of September. There's quite a few JIRAs still open: http://goo.gl/ufhFF
Please go through them and if you're deferring anything, please reply.
Cheers,
--
Galder Zamarreño
Sr. Software Engineer
Infinispan, JBoss Cache
12 years, 7 months
Why DistTxInterceptor in use with Hot Rod ?
by Galder Zamarreño
Hi,
I'm looking at this failure http://goo.gl/NQw4h and I'm wondering why "org.infinispan.distribution.RehashInProgressException: Timed out waiting for the transaction lock" is thrown?
This is thrown DistTxInterceptor which is added by the InterceptorChainFactory:
if (configuration.getCacheMode().isDistributed())
interceptorChain.appendInterceptor(createInterceptor(DistTxInterceptor.class));
else
interceptorChain.appendInterceptor(createInterceptor(TxInterceptor.class));
However, this is a Hot Rod test and the cache is not configured with a transaction manager, so is DistTxInterceptor really needed?
In fact, why a TxInterceptor if no transaction manager is configured? (this kinda goes back to Mircea's email earlier today about a transactions enabled/disabled flag)
Cheers,
--
Galder Zamarreño
Sr. Software Engineer
Infinispan, JBoss Cache
12 years, 7 months
