[jboss-jira] [JBoss JIRA] Updated: (AS7-1507) Session replication broken

Session replication broken -------------------------- Key: AS7-1507 URL: https://issues.jboss.org/browse/AS7-1507 Project: Application Server 7 Issue Type: Bug Components: Clustering Environment: Latest AS7 snapshot (2011-08-09) Reporter: Jozef Hartinger Assignee: Paul Ferraro Priority: Blocker Attachments: weld-numberguess.war 1.) Configure two standalone configurations to run in a cluster 2.) Run both the servers with standalone-ha configuration 3.) Deploy the attached application to both server instances 4.) Verify, that the application is clustered. You should see the following lines in the server log: 15:38:32,281 INFO [org.jboss.as.clustering.CoreGroupCommunicationService.lifecycle.web] (Incoming-5,web,x201-56464) New cluster view for partition web (id: 1, delta: 1, merge: false) : [x201-56464, x201-32968] 15:38:32,282 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-5,web,x201-56464) ISPN000094: Received new cluster view: [x201-56464|1] [x201-56464, x201-32968] 5.) Go to http://localhost:8080/weld-numberguess 6.) The following exception appears in the server log {noformat} 15:39:42,409 ERROR [org.infinispan.remoting.ReplicationQueue] (Scheduled-replicationQueue-thread-0) ISPN000072: Failed replicating 1 elements in replication queue: org.infinispan.CacheException: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.util.Util.rewrapAsCacheException(Util.java:551) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:117) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:440) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:132) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:160) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.ReplicationQueueImpl.flush(ReplicationQueueImpl.java:159) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.ReplicationQueueImpl$1.run(ReplicationQueueImpl.java:112) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_24] at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_24] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204) [:1.6.0_24] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_24] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_24] at java.lang.Thread.run(Thread.java:662) [:1.6.0_24] Caused by: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.marshallCall(CommandAwareRpcDispatcher.java:216) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:237) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:115) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] ... 14 more Caused by: org.infinispan.CacheException: Unable to marshall value AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@1d78ff42} at org.infinispan.marshall.MarshalledValue.serialize0(MarshalledValue.java:125) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.MarshalledValue.serialize(MarshalledValue.java:93) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.MarshalledValue.getRaw(MarshalledValue.java:202) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.MarshalledValue$Externalizer.writeObject(MarshalledValue.java:314) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.MarshalledValue$Externalizer.writeObject(MarshalledValue.java:305) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:100) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:71) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:100) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:71) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:100) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:71) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.jboss.GenericJBossMarshaller.objectToObjectStream(GenericJBossMarshaller.java:122) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.VersionAwareMarshaller.objectToBuffer(VersionAwareMarshaller.java:98) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.AbstractMarshaller.objectToBuffer(AbstractMarshaller.java:65) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectToBuffer(MarshallerAdapter.java:44) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.marshallCall(CommandAwareRpcDispatcher.java:214) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] ... 16 more Caused by: java.lang.IllegalStateException: Singleton not set for ModuleClassLoader for Module "org.jboss.as.clustering.infinispan:main" from local module loader @7f2a3793 (roots: /home/jharting/jboss/testing/WELD-863/jboss-as-7.1.0.Alpha1-SNAPSHOT/modules) at org.jboss.as.weld.services.ModuleGroupSingletonProvider$TCCLSingleton.get(ModuleGroupSingletonProvider.java:71) at org.jboss.weld.Container.instance(Container.java:58) at org.jboss.weld.injection.WeldInjectionPoint$WeldInjectionPointSerializationProxy.<init>(WeldInjectionPoint.java:43) at org.jboss.weld.injection.FieldInjectionPoint$SerializationProxy.<init>(FieldInjectionPoint.java:216) at org.jboss.weld.injection.FieldInjectionPoint.writeReplace(FieldInjectionPoint.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [:1.6.0_24] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [:1.6.0_24] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [:1.6.0_24] at java.lang.reflect.Method.invoke(Method.java:597) [:1.6.0_24] at org.jboss.marshalling.reflect.SerializableClass.callWriteReplace(SerializableClass.java:286) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:190) at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1057) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1013) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:992) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1057) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1013) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:585) at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1057) at org.jboss.marshalling.river.RiverObjectOutputStream.defaultWriteObject(RiverObjectOutputStream.java:159) at java.util.Collections$SynchronizedCollection.writeObject(Collections.java:1602) [:1.6.0_24] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [:1.6.0_24] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [:1.6.0_24] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [:1.6.0_24] at java.lang.reflect.Method.invoke(Method.java:597) [:1.6.0_24] at org.jboss.marshalling.reflect.SerializableClass.callWriteObject(SerializableClass.java:173) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1001) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:992) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1057) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1013) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1057) at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1013) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:677) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.as.clustering.SimpleMarshalledValue.getBytes(SimpleMarshalledValue.java:63) at org.jboss.as.clustering.SimpleMarshalledValue.writeObject(SimpleMarshalledValue.java:139) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [:1.6.0_24] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [:1.6.0_24] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [:1.6.0_24] at java.lang.reflect.Method.invoke(Method.java:597) [:1.6.0_24] at org.jboss.marshalling.reflect.SerializableClass.callWriteObject(SerializableClass.java:173) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1001) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:879) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.MarshallUtil.marshallMap(MarshallUtil.java:60) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.exts.MapExternalizer.writeObject(MapExternalizer.java:63) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.exts.MapExternalizer.writeObject(MapExternalizer.java:47) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.atomic.AtomicHashMap$Externalizer.writeObject(AtomicHashMap.java:225) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.atomic.AtomicHashMap$Externalizer.writeObject(AtomicHashMap.java:222) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:361) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.0.GA.jar:1.3.0.GA] at org.infinispan.marshall.jboss.GenericJBossMarshaller.objectToObjectStream(GenericJBossMarshaller.java:122) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.VersionAwareMarshaller.objectToObjectStream(VersionAwareMarshaller.java:157) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] at org.infinispan.marshall.MarshalledValue.serialize0(MarshalledValue.java:108) [infinispan-core-5.0.0.FINAL.jar:5.0.0.FINAL] ... 47 more Caused by: an exception which occurred: in field injectionPoint in field instance in field c in field dependentInstances in field creationalContext in object java.util.HashMap@c25c0c19 in object org.jboss.as.clustering.SimpleMarshalledValue@c25c0c19 in object org.infinispan.util.FastCopyHashMap@1d78ff42 in object org.infinispan.atomic.AtomicHashMap@7992eec1 in object org.infinispan.marshall.MarshalledValue@7992eec1 in object org.infinispan.commands.write.PutKeyValueCommand@e401eb65 in object org.infinispan.commands.tx.PrepareCommand@31ec4952 in object org.infinispan.commands.remote.MultipleRpcCommand@bd2401e {noformat}