[infinispan-issues] [JBoss JIRA] Commented: (ISPN-832) TimeoutException with 2 or more nodes when there are Entity inserts, updates or removes.

[ https://issues.jboss.org/browse/ISPN-832?page=com.atlassian.jira.plugin.s... ] Cyrille Charron commented on ISPN-832: -------------------------------------- I don't know if this stack trace can help you, neither if it is the same root cause, but i reproduced it at least 3 times at home. It seems that the cache named "org.hibernate.cache.UpdateTimestampsCache" is not yet defined while the 2 nodes are merging. Node 1 : 01:13:44,411 Strike any key to start 01:13:51,556 InfiniSpanTest is starting its node 0/2 18 déc. 2010 01:13:51 org.apache.openejb.cdi.CdiBuilder <init> INFO: Created new singletonService org.apache.openejb.cdi.ThreadSingletonServiceImpl@1f8c6df 18 déc. 2010 01:13:51 org.apache.openejb.cdi.CdiBuilder <init> INFO: succeeded in installing singleton service Apache OpenEJB 3.2-SNAPSHOT build: 20101203-01:57 http://openejb.apache.org/ 18-12 01:13:51,760 INFO Log4jLogStream -openejb.home = C:\Users\Cyrille\workspace\InfiniSpanTest 18-12 01:13:51,760 INFO Log4jLogStream -openejb.base = C:\Users\Cyrille\workspace\InfiniSpanTest 18-12 01:13:52,057 INFO Log4jLogStream -Configuring Service(id=Default Security Service, type=SecurityService, provider-id=Default Security Service) 18-12 01:13:52,057 INFO Log4jLogStream -Configuring Service(id=Default Transaction Manager, type=TransactionManager, provider-id=Default Transaction Manager) 18-12 01:13:52,057 INFO Log4jLogStream -Configuring Service(id=jpacacheDS, type=Resource, provider-id=Default JDBC Database) 18-12 01:13:52,057 INFO Log4jLogStream -Configuring Service(id=My Stateless Container, type=Container, provider-id=Default Stateless Container) 18-12 01:13:52,088 INFO Log4jLogStream -Found EjbModule in classpath: C:\Users\Cyrille\workspace\InfiniSpanTest\target\classes 18-12 01:13:52,104 INFO Log4jLogStream -Found EjbModule in classpath: C:\Users\Cyrille\workspace\InfiniSpanTest\target\test-classes 18-12 01:13:52,168 INFO Log4jLogStream -Beginning load: C:\Users\Cyrille\workspace\InfiniSpanTest\target\classes 18-12 01:13:52,513 INFO Log4jLogStream -Beginning load: C:\Users\Cyrille\workspace\InfiniSpanTest\target\test-classes 18-12 01:13:52,560 INFO Log4jLogStream -Configuring enterprise application: classpath.ear 18-12 01:13:52,639 INFO Log4jLogStream -Configuring PersistenceUnit(name=jpacache, provider=org.hibernate.ejb.HibernatePersistence) 18-12 01:13:52,655 INFO Log4jLogStream -Auto-creating a Resource with id 'jpacacheDSNonJta' of type 'DataSource for 'jpacache'. 18-12 01:13:52,655 INFO Log4jLogStream -Configuring Service(id=jpacacheDSNonJta, type=Resource, provider-id=jpacacheDS) 18-12 01:13:52,655 INFO Log4jLogStream -Adjusting PersistenceUnit jpacache <non-jta-data-source> to Resource ID 'jpacacheDSNonJta' from 'null' 18-12 01:13:52,655 INFO Log4jLogStream -Enterprise application "classpath.ear" loaded. 18-12 01:13:52,670 INFO Log4jLogStream -Creating TransactionManager(id=Default Transaction Manager) 18-12 01:13:52,717 INFO Log4jLogStream -Creating SecurityService(id=Default Security Service) 18-12 01:13:52,733 INFO Log4jLogStream -Creating Resource(id=jpacacheDS) 18-12 01:13:52,748 INFO Log4jLogStream -Creating Resource(id=jpacacheDSNonJta) 18-12 01:13:52,748 INFO Log4jLogStream -Creating Container(id=My Stateless Container) 18-12 01:13:52,764 INFO Log4jLogStream -Assembling app: classpath.ear 18-12 01:13:53,826 INFO JGroupsTransport -Starting JGroups Channel ------------------------------------------------------------------- GMS: address=ccc1-1844, cluster=infinispan-hibernate-cluster, physical address=fe80:0:0:0:c488:ce01:b817:a808:50840 ------------------------------------------------------------------- 18-12 01:13:55,154 INFO AbstractLogImpl -Received new cluster view: [ccc1-1844|0] [ccc1-1844] 18-12 01:13:55,154 INFO AbstractLogImpl -Cache local address is ccc1-1844, physical addresses are [fe80:0:0:0:c488:ce01:b817:a808:50840] 18-12 01:13:55,154 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,169 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,280 INFO AbstractLogImpl -Received new cluster view: [ccc1-1844|1] [ccc1-1844, ccc1-37855] 18-12 01:13:55,295 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,311 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,311 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,326 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,389 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,593 ERROR RpcManagerImpl -unexpected error while replicating org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:72) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 18-12 01:13:55,593 ERROR InvocationContextInterceptor -Execution error: org.infinispan.loaders.CacheLoaderException: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:102) at org.infinispan.loaders.cluster.ClusterCacheLoader.load(ClusterCacheLoader.java:54) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:148) at org.infinispan.interceptors.CacheLoaderInterceptor.visitPutKeyValueCommand(CacheLoaderInterceptor.java:79) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitPutKeyValueCommand(MarshalledValueInterceptor.java:125) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:182) at org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:130) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) at org.infinispan.CacheDelegate.put(CacheDelegate.java:444) at org.infinispan.CacheSupport.put(CacheSupport.java:28) at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:99) at org.hibernate.cache.infinispan.util.CacheHelper.initInternalEvict(CacheHelper.java:53) at org.hibernate.cache.infinispan.impl.BaseRegion.establishInternalNodes(BaseRegion.java:83) at org.hibernate.cache.infinispan.impl.BaseRegion.start(BaseRegion.java:70) at org.hibernate.cache.infinispan.InfinispanRegionFactory.buildTimestampsRegion(InfinispanRegionFactory.java:209) at org.hibernate.cache.UpdateTimestampsCache.<init>(UpdateTimestampsCache.java:58) at org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:396) at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1842) at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:902) at org.hibernate.ejb.HibernatePersistence.createContainerEntityManagerFactory(HibernatePersistence.java:74) at org.apache.openejb.assembler.classic.PersistenceBuilder.createEntityManagerFactory(PersistenceBuilder.java:198) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:520) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:461) at org.apache.openejb.assembler.classic.Assembler.buildContainerSystem(Assembler.java:371) at org.apache.openejb.assembler.classic.Assembler.build(Assembler.java:283) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:130) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:63) at org.apache.openejb.OpenEJB.init(OpenEJB.java:276) at org.apache.openejb.OpenEJB.init(OpenEJB.java:255) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.openejb.loader.OpenEJBInstance.init(OpenEJBInstance.java:36) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:71) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:53) at org.apache.openejb.client.LocalInitialContextFactory.getInitialContext(LocalInitialContextFactory.java:42) at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:667) at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288) at javax.naming.InitialContext.init(InitialContext.java:223) at javax.naming.InitialContext.<init>(InitialContext.java:197) at infiniSpanTest.Runner.init(Runner.java:117) at infiniSpanTest.Runner.main(Runner.java:429) Caused by: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:114) at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:99) ... 61 more Caused by: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:72) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 18-12 01:13:55,593 INFO Log4jLogStream -PersistenceUnit(name=jpacache, provider=org.hibernate.ejb.HibernatePersistence) - provider time 2815ms 18-12 01:13:55,593 INFO Log4jLogStream -Undeploying app: classpath.ear 18-12 01:13:55,671 ERROR Log4jLogStream -Application could not be deployed: classpath.ear org.apache.openejb.OpenEJBException: Creating application failed: classpath.ear: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:752) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:461) at org.apache.openejb.assembler.classic.Assembler.buildContainerSystem(Assembler.java:371) at org.apache.openejb.assembler.classic.Assembler.build(Assembler.java:283) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:130) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:63) at org.apache.openejb.OpenEJB.init(OpenEJB.java:276) at org.apache.openejb.OpenEJB.init(OpenEJB.java:255) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.openejb.loader.OpenEJBInstance.init(OpenEJBInstance.java:36) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:71) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:53) at org.apache.openejb.client.LocalInitialContextFactory.getInitialContext(LocalInitialContextFactory.java:42) at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:667) at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288) at javax.naming.InitialContext.init(InitialContext.java:223) at javax.naming.InitialContext.<init>(InitialContext.java:197) at infiniSpanTest.Runner.init(Runner.java:117) at infiniSpanTest.Runner.main(Runner.java:429) Caused by: org.apache.openejb.OpenEJBException: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:525) ... 21 more Caused by: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:911) at org.hibernate.ejb.HibernatePersistence.createContainerEntityManagerFactory(HibernatePersistence.java:74) at org.apache.openejb.assembler.classic.PersistenceBuilder.createEntityManagerFactory(PersistenceBuilder.java:198) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:520) ... 21 more Caused by: org.hibernate.cache.CacheException: org.infinispan.CacheException: org.infinispan.loaders.CacheLoaderException: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:101) at org.hibernate.cache.infinispan.util.CacheHelper.initInternalEvict(CacheHelper.java:53) at org.hibernate.cache.infinispan.impl.BaseRegion.establishInternalNodes(BaseRegion.java:83) at org.hibernate.cache.infinispan.impl.BaseRegion.start(BaseRegion.java:70) at org.hibernate.cache.infinispan.InfinispanRegionFactory.buildTimestampsRegion(InfinispanRegionFactory.java:209) at org.hibernate.cache.UpdateTimestampsCache.<init>(UpdateTimestampsCache.java:58) at org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:396) at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1842) at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:902) ... 24 more Caused by: org.infinispan.CacheException: org.infinispan.loaders.CacheLoaderException: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:281) at org.infinispan.CacheDelegate.put(CacheDelegate.java:444) at org.infinispan.CacheSupport.put(CacheSupport.java:28) at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:99) ... 32 more Caused by: org.infinispan.loaders.CacheLoaderException: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:102) at org.infinispan.loaders.cluster.ClusterCacheLoader.load(ClusterCacheLoader.java:54) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:148) at org.infinispan.interceptors.CacheLoaderInterceptor.visitPutKeyValueCommand(CacheLoaderInterceptor.java:79) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitPutKeyValueCommand(MarshalledValueInterceptor.java:125) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:182) at org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:130) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) ... 35 more Caused by: org.infinispan.CacheException: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:114) at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:99) ... 61 more Caused by: org.infinispan.manager.NamedCacheNotFoundException: Cache: org.hibernate.cache.UpdateTimestampsCache at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:72) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 01:13:55,671 Test of node 0/2 will begin now javax.naming.NameNotFoundException: Name "FamilyManagerBeanLocal" not found. at org.apache.openejb.core.ivm.naming.IvmContext.federate(IvmContext.java:193) at org.apache.openejb.core.ivm.naming.IvmContext.lookup(IvmContext.java:150) at org.apache.openejb.core.ivm.naming.ContextWrapper.lookup(ContextWrapper.java:115) at javax.naming.InitialContext.lookup(InitialContext.java:392) at infiniSpanTest.JndiLookup.getResource(JndiLookup.java:22) at infiniSpanTest.Runner.setManager(Runner.java:92) at infiniSpanTest.Runner.<init>(Runner.java:82) at infiniSpanTest.Runner.main(Runner.java:437) 01:13:55,686 InfiniSpanTest is stopping its node 0/2 18-12 01:13:55,686 INFO Log4jLogStream -Destroying container system 18-12 01:13:55,686 INFO Log4jLogStream -Closing DataSource: jpacacheDS 18-12 01:13:55,686 INFO Log4jLogStream -Closing DataSource: jpacacheDSNonJta 18-12 01:14:10,585 ERROR InvocationContextInterceptor -Execution error: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.container.EntryFactoryImpl.acquireLock(EntryFactoryImpl.java:228) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:132) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeededAndUpdateStats(CacheLoaderInterceptor.java:217) at org.infinispan.interceptors.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:89) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitGetKeyValueCommand(MarshalledValueInterceptor.java:168) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistReadAndInvokeNext(TxInterceptor.java:169) at org.infinispan.interceptors.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:160) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:95) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:51) at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:94) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Node 2 : 01:13:45,768 Strike any key to start 01:13:52,135 InfiniSpanTest is starting its node 1/2 18 déc. 2010 01:13:52 org.apache.openejb.cdi.CdiBuilder <init> INFO: Created new singletonService org.apache.openejb.cdi.ThreadSingletonServiceImpl@1c86be5 Apache OpenEJB 3.2-SNAPSHOT build: 20101203-01:57 http://openejb.apache.org/ 18-12 01:13:52,309 INFO Log4jLogStream -openejb.home = C:\Users\Cyrille\workspace\InfiniSpanTest 18-12 01:13:52,324 INFO Log4jLogStream -openejb.base = C:\Users\Cyrille\workspace\InfiniSpanTest 18 déc. 2010 01:13:52 org.apache.openejb.cdi.CdiBuilder <init> INFO: succeeded in installing singleton service 18-12 01:13:52,624 INFO Log4jLogStream -Configuring Service(id=Default Security Service, type=SecurityService, provider-id=Default Security Service) 18-12 01:13:52,624 INFO Log4jLogStream -Configuring Service(id=Default Transaction Manager, type=TransactionManager, provider-id=Default Transaction Manager) 18-12 01:13:52,624 INFO Log4jLogStream -Configuring Service(id=jpacacheDS, type=Resource, provider-id=Default JDBC Database) 18-12 01:13:52,624 INFO Log4jLogStream -Configuring Service(id=My Stateless Container, type=Container, provider-id=Default Stateless Container) 18-12 01:13:52,655 INFO Log4jLogStream -Found EjbModule in classpath: C:\Users\Cyrille\workspace\InfiniSpanTest\target\classes 18-12 01:13:52,655 INFO Log4jLogStream -Found EjbModule in classpath: C:\Users\Cyrille\workspace\InfiniSpanTest\target\test-classes 18-12 01:13:52,733 INFO Log4jLogStream -Beginning load: C:\Users\Cyrille\workspace\InfiniSpanTest\target\classes 18-12 01:13:53,076 INFO Log4jLogStream -Beginning load: C:\Users\Cyrille\workspace\InfiniSpanTest\target\test-classes 18-12 01:13:53,107 INFO Log4jLogStream -Configuring enterprise application: classpath.ear 18-12 01:13:53,201 INFO Log4jLogStream -Configuring PersistenceUnit(name=jpacache, provider=org.hibernate.ejb.HibernatePersistence) 18-12 01:13:53,201 INFO Log4jLogStream -Auto-creating a Resource with id 'jpacacheDSNonJta' of type 'DataSource for 'jpacache'. 18-12 01:13:53,201 INFO Log4jLogStream -Configuring Service(id=jpacacheDSNonJta, type=Resource, provider-id=jpacacheDS) 18-12 01:13:53,201 INFO Log4jLogStream -Adjusting PersistenceUnit jpacache <non-jta-data-source> to Resource ID 'jpacacheDSNonJta' from 'null' 18-12 01:13:53,216 INFO Log4jLogStream -Enterprise application "classpath.ear" loaded. 18-12 01:13:53,216 INFO Log4jLogStream -Creating TransactionManager(id=Default Transaction Manager) 18-12 01:13:53,280 INFO Log4jLogStream -Creating SecurityService(id=Default Security Service) 18-12 01:13:53,295 INFO Log4jLogStream -Creating Resource(id=jpacacheDS) 18-12 01:13:53,311 INFO Log4jLogStream -Creating Resource(id=jpacacheDSNonJta) 18-12 01:13:53,311 INFO Log4jLogStream -Creating Container(id=My Stateless Container) 18-12 01:13:53,327 INFO Log4jLogStream -Assembling app: classpath.ear 18-12 01:13:54,373 INFO JGroupsTransport -Starting JGroups Channel ------------------------------------------------------------------- GMS: address=ccc1-37855, cluster=infinispan-hibernate-cluster, physical address=fe80:0:0:0:c488:ce01:b817:a808:50841 ------------------------------------------------------------------- 18-12 01:13:55,295 INFO AbstractLogImpl -Received new cluster view: [ccc1-1844|1] [ccc1-1844, ccc1-37855] 18-12 01:13:55,326 INFO AbstractLogImpl -Cache local address is ccc1-37855, physical addresses are [fe80:0:0:0:c488:ce01:b817:a808:50841] 18-12 01:13:55,326 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,326 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,436 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,451 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,451 ERROR AbstractLogImpl -Defined caches: [timestamps, entity-repeatable, entity, local-query, replicated-query, infiniSpanTest.Family, family-entity, person-entity, infiniSpanTest.Person, replicated-entity, infiniSpanTest.Address, address-entity] 18-12 01:13:55,451 INFO AbstractLogImpl -Cache org.hibernate.cache.UpdateTimestampsCache is not defined. No point in waiting. 18-12 01:13:55,451 INFO AbstractLogImpl -Cache named org.hibernate.cache.UpdateTimestampsCache does not exist on this cache manager! 18-12 01:13:55,451 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,468 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:13:55,530 INFO AbstractComponentRegistry -Infinispan version: Infinispan 'Ursus' 4.2.0-SNAPSHOT 18-12 01:14:10,695 ERROR InvocationContextInterceptor -Execution error: org.infinispan.loaders.CacheLoaderException: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:102) at org.infinispan.loaders.cluster.ClusterCacheLoader.load(ClusterCacheLoader.java:54) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:148) at org.infinispan.interceptors.CacheLoaderInterceptor.visitPutKeyValueCommand(CacheLoaderInterceptor.java:79) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitPutKeyValueCommand(MarshalledValueInterceptor.java:125) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:182) at org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:130) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) at org.infinispan.CacheDelegate.put(CacheDelegate.java:444) at org.infinispan.CacheSupport.put(CacheSupport.java:28) at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:99) at org.hibernate.cache.infinispan.util.CacheHelper.initInternalEvict(CacheHelper.java:53) at org.hibernate.cache.infinispan.impl.BaseRegion.establishInternalNodes(BaseRegion.java:83) at org.hibernate.cache.infinispan.impl.BaseRegion.start(BaseRegion.java:70) at org.hibernate.cache.infinispan.InfinispanRegionFactory.buildTimestampsRegion(InfinispanRegionFactory.java:209) at org.hibernate.cache.UpdateTimestampsCache.<init>(UpdateTimestampsCache.java:58) at org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:396) at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1842) at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:902) at org.hibernate.ejb.HibernatePersistence.createContainerEntityManagerFactory(HibernatePersistence.java:74) at org.apache.openejb.assembler.classic.PersistenceBuilder.createEntityManagerFactory(PersistenceBuilder.java:198) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:520) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:461) at org.apache.openejb.assembler.classic.Assembler.buildContainerSystem(Assembler.java:371) at org.apache.openejb.assembler.classic.Assembler.build(Assembler.java:283) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:130) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:63) at org.apache.openejb.OpenEJB.init(OpenEJB.java:276) at org.apache.openejb.OpenEJB.init(OpenEJB.java:255) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.openejb.loader.OpenEJBInstance.init(OpenEJBInstance.java:36) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:71) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:53) at org.apache.openejb.client.LocalInitialContextFactory.getInitialContext(LocalInitialContextFactory.java:42) at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:667) at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288) at javax.naming.InitialContext.init(InitialContext.java:223) at javax.naming.InitialContext.<init>(InitialContext.java:197) at infiniSpanTest.Runner.init(Runner.java:117) at infiniSpanTest.Runner.main(Runner.java:429) Caused by: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.container.EntryFactoryImpl.acquireLock(EntryFactoryImpl.java:228) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:132) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeededAndUpdateStats(CacheLoaderInterceptor.java:217) at org.infinispan.interceptors.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:89) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitGetKeyValueCommand(MarshalledValueInterceptor.java:168) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistReadAndInvokeNext(TxInterceptor.java:169) at org.infinispan.interceptors.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:160) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:95) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:51) at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:94) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 18-12 01:14:10,711 INFO Log4jLogStream -PersistenceUnit(name=jpacache, provider=org.hibernate.ejb.HibernatePersistence) - provider time 17367ms 18-12 01:14:10,711 INFO Log4jLogStream -Undeploying app: classpath.ear 18-12 01:14:10,774 ERROR Log4jLogStream -Application could not be deployed: classpath.ear org.apache.openejb.OpenEJBException: Creating application failed: classpath.ear: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:752) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:461) at org.apache.openejb.assembler.classic.Assembler.buildContainerSystem(Assembler.java:371) at org.apache.openejb.assembler.classic.Assembler.build(Assembler.java:283) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:130) at org.apache.openejb.OpenEJB$Instance.<init>(OpenEJB.java:63) at org.apache.openejb.OpenEJB.init(OpenEJB.java:276) at org.apache.openejb.OpenEJB.init(OpenEJB.java:255) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.openejb.loader.OpenEJBInstance.init(OpenEJBInstance.java:36) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:71) at org.apache.openejb.client.LocalInitialContextFactory.init(LocalInitialContextFactory.java:53) at org.apache.openejb.client.LocalInitialContextFactory.getInitialContext(LocalInitialContextFactory.java:42) at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:667) at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288) at javax.naming.InitialContext.init(InitialContext.java:223) at javax.naming.InitialContext.<init>(InitialContext.java:197) at infiniSpanTest.Runner.init(Runner.java:117) at infiniSpanTest.Runner.main(Runner.java:429) Caused by: org.apache.openejb.OpenEJBException: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:525) ... 21 more Caused by: javax.persistence.PersistenceException: [PersistenceUnit: jpacache] Unable to build EntityManagerFactory at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:911) at org.hibernate.ejb.HibernatePersistence.createContainerEntityManagerFactory(HibernatePersistence.java:74) at org.apache.openejb.assembler.classic.PersistenceBuilder.createEntityManagerFactory(PersistenceBuilder.java:198) at org.apache.openejb.assembler.classic.Assembler.createApplication(Assembler.java:520) ... 21 more Caused by: org.hibernate.cache.CacheException: org.infinispan.CacheException: org.infinispan.loaders.CacheLoaderException: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:101) at org.hibernate.cache.infinispan.util.CacheHelper.initInternalEvict(CacheHelper.java:53) at org.hibernate.cache.infinispan.impl.BaseRegion.establishInternalNodes(BaseRegion.java:83) at org.hibernate.cache.infinispan.impl.BaseRegion.start(BaseRegion.java:70) at org.hibernate.cache.infinispan.InfinispanRegionFactory.buildTimestampsRegion(InfinispanRegionFactory.java:209) at org.hibernate.cache.UpdateTimestampsCache.<init>(UpdateTimestampsCache.java:58) at org.hibernate.impl.SessionFactoryImpl.<init>(SessionFactoryImpl.java:396) at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1842) at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:902) ... 24 more Caused by: org.infinispan.CacheException: org.infinispan.loaders.CacheLoaderException: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:281) at org.infinispan.CacheDelegate.put(CacheDelegate.java:444) at org.infinispan.CacheSupport.put(CacheSupport.java:28) at org.hibernate.cache.infinispan.util.CacheAdapterImpl.put(CacheAdapterImpl.java:99) ... 32 more Caused by: org.infinispan.loaders.CacheLoaderException: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.loaders.cluster.ClusterCacheLoader.doRemoteCall(ClusterCacheLoader.java:102) at org.infinispan.loaders.cluster.ClusterCacheLoader.load(ClusterCacheLoader.java:54) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:148) at org.infinispan.interceptors.CacheLoaderInterceptor.visitPutKeyValueCommand(CacheLoaderInterceptor.java:79) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitPutKeyValueCommand(MarshalledValueInterceptor.java:125) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:182) at org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:130) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:58) at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:76) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) ... 35 more Caused by: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [org.hibernate.cache.infinispan.util.CacheHelper$EvictAll@9e0f3801] for requestor [Thread[Incoming-2,ccc1-1844,5,Thread Pools]]! Lock held by [Thread[main,5,]] at org.infinispan.container.EntryFactoryImpl.acquireLock(EntryFactoryImpl.java:228) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeeded(CacheLoaderInterceptor.java:132) at org.infinispan.interceptors.CacheLoaderInterceptor.loadIfNeededAndUpdateStats(CacheLoaderInterceptor.java:217) at org.infinispan.interceptors.CacheLoaderInterceptor.visitGetKeyValueCommand(CacheLoaderInterceptor.java:89) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.MarshalledValueInterceptor.visitGetKeyValueCommand(MarshalledValueInterceptor.java:168) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.TxInterceptor.enlistReadAndInvokeNext(TxInterceptor.java:169) at org.infinispan.interceptors.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:160) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:87) at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:58) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) at org.hibernate.cache.infinispan.impl.ClassLoaderAwareCache$ClassLoaderAwareCommandInterceptor.handleDefault(ClassLoaderAwareCache.java:79) at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:88) at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:59) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:273) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:95) at org.infinispan.commands.remote.ClusteredGetCommand.perform(ClusteredGetCommand.java:51) at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:94) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:177) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:149) at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:578) at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:489) at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:365) at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:771) at org.jgroups.JChannel.up(JChannel.java:1465) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:954) at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:478) at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:265) at org.jgroups.protocols.FRAG2.up(FRAG2.java:190) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.FlowControl.up(FlowControl.java:419) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) at org.jgroups.protocols.UNICAST.up(UNICAST.java:310) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:836) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:671) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132) at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:169) at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:269) at org.jgroups.protocols.MERGE2.up(MERGE2.java:210) at org.jgroups.protocols.Discovery.up(Discovery.java:292) at org.jgroups.protocols.PING.up(PING.java:67) at org.jgroups.protocols.TP.passMessageUp(TP.java:1093) at org.jgroups.protocols.TP.access$100(TP.java:56) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1633) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1615) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 01:14:10,774 Test of node 1/2 will begin now javax.naming.NameNotFoundException: Name "FamilyManagerBeanLocal" not found. at org.apache.openejb.core.ivm.naming.IvmContext.federate(IvmContext.java:193) at org.apache.openejb.core.ivm.naming.IvmContext.lookup(IvmContext.java:150) at org.apache.openejb.core.ivm.naming.ContextWrapper.lookup(ContextWrapper.java:115) at javax.naming.InitialContext.lookup(InitialContext.java:392) at infiniSpanTest.JndiLookup.getResource(JndiLookup.java:22) at infiniSpanTest.Runner.setManager(Runner.java:92) at infiniSpanTest.Runner.<init>(Runner.java:82) at infiniSpanTest.Runner.main(Runner.java:437) 01:14:10,790 InfiniSpanTest is stopping its node 1/2 18-12 01:14:10,790 INFO Log4jLogStream -Destroying container system 18-12 01:14:10,790 INFO Log4jLogStream -Closing DataSource: jpacacheDS 18-12 01:14:10,790 INFO Log4jLogStream -Closing DataSource: jpacacheDSNonJta -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira