[jboss-jira] [JBoss JIRA] (AS7-2563) NPE accessing replicated HTTP session with JSF state

NPE accessing replicated HTTP session with JSF state ---------------------------------------------------- Key: AS7-2563 URL: https://issues.jboss.org/browse/AS7-2563 Project: Application Server 7 Issue Type: Bug Components: Clustering Environment: jboss-as-7.1.0.Alpha2-SNAPSHOT (2011-11-09) Reporter: Marek Schmidt Assignee: Paul Ferraro Priority: Critical Labels: eap6-clustering, eap6_prd_req, failover_testing Fix For: 7.1.0.Final Attachments: AS7-2563-logs.tar.bz2, jboss-as-numberguess-nocdi.war 1.) Start two standalone AS7 instances (standalone-ha configuration) on node1 and node2 (e.g. <loopback-address value="127.0.1.1"/> and <loopback-address value="127.0.2.1"/> node1/bin/standalone.sh --server-config=standalone-ha.xml -Djboss.node.name=node1 node2/bin/standalone.sh --server-config=standalone-ha.xml -Djboss.node.name=node2 2.) Deploy the attached application to both instances 3.) Open http://node2:8080/jboss-as-numberguess-nocdi and enter a guess 4.) Copy the node2 JSESSIONID cookie to node1 JSESSIONID cookie 5.) Open http://node1:8080/jboss-as-numberguess-nocdi/home.jsf Expected: Game state replicated including the latest guess. Actual: an HTTP 500 page with the following exception appears: The same WAR works correctly on AS6 in the same scenario. Note that the WAR does not contain beans.xml nor use CDI in any way, in contrast to AS7-2496 {noformat} java.lang.NullPointerException java.util.HashMap.getEntry(HashMap.java:345) java.util.LinkedHashMap.get(LinkedHashMap.java:280) com.sun.faces.renderkit.ServerSideStateHelper.writeState(ServerSideStateHelper.java:208) com.sun.faces.renderkit.ResponseStateManagerImpl.writeState(ResponseStateManagerImpl.java:122) com.sun.faces.application.StateManagerImpl.writeState(StateManagerImpl.java:166) com.sun.faces.application.view.WriteBehindStateWriter.flushToWriter(WriteBehindStateWriter.java:225) com.sun.faces.application.view.FaceletViewHandlingStrategy.renderView(FaceletViewHandlingStrategy.java:418) com.sun.faces.application.view.MultiViewHandler.renderView(MultiViewHandler.java:131) com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:121) com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101) com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139) javax.faces.webapp.FacesServlet.service(FacesServlet.java:594) {noformat} Sometimes, but not always, the following appears in the log in addition to the exception: {noformat} 17:13:50,718 SEVERE [javax.enterprise.resource.webcontainer.jsf.application] (http-node1-127.0.1.1-8080-3) Error Rendering View[/home.xhtml]: java.lang.NullPointerException at java.util.HashMap.getEntry(HashMap.java:345) [:1.6.0_24] at java.util.LinkedHashMap.get(LinkedHashMap.java:280) [:1.6.0_24] at com.sun.faces.renderkit.ServerSideStateHelper.writeState(ServerSideStateHelper.java:208) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.renderkit.ResponseStateManagerImpl.writeState(ResponseStateManagerImpl.java:122) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.StateManagerImpl.writeState(StateManagerImpl.java:166) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.WriteBehindStateWriter.flushToWriter(WriteBehindStateWriter.java:225) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.FaceletViewHandlingStrategy.renderView(FaceletViewHandlingStrategy.java:418) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.MultiViewHandler.renderView(MultiViewHandler.java:131) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:121) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at javax.faces.webapp.FacesServlet.service(FacesServlet.java:594) [jboss-jsf-api_2.1_spec-2.0.0.Beta1.jar:2.0.0.Beta1] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.modcluster.catalina.CatalinaContext$RequestListenerValve.event(CatalinaContext.java:285) at org.jboss.modcluster.catalina.CatalinaContext$RequestListenerValve.invoke(CatalinaContext.java:261) at org.jboss.as.web.session.ClusteredSessionValve.handleRequest(ClusteredSessionValve.java:123) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:89) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.JvmRouteValve.invoke(JvmRouteValve.java:88) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.LockingValve.invoke(LockingValve.java:56) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.handleRequest(ClusteredSessionValve.java:123) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:89) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.JvmRouteValve.invoke(JvmRouteValve.java:88) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.LockingValve.invoke(LockingValve.java:56) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:155) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:362) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at java.lang.Thread.run(Thread.java:662) [:1.6.0_24] 17:13:50,723 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/jboss-as-numberguess-nocdi].[Faces Servlet]] (http-node1-127.0.1.1-8080-3) Servlet.service() for servlet Faces Servlet threw exception: java.lang.NullPointerException at java.util.HashMap.getEntry(HashMap.java:345) [:1.6.0_24] at java.util.LinkedHashMap.get(LinkedHashMap.java:280) [:1.6.0_24] at com.sun.faces.renderkit.ServerSideStateHelper.writeState(ServerSideStateHelper.java:208) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.renderkit.ResponseStateManagerImpl.writeState(ResponseStateManagerImpl.java:122) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.StateManagerImpl.writeState(StateManagerImpl.java:166) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.WriteBehindStateWriter.flushToWriter(WriteBehindStateWriter.java:225) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.FaceletViewHandlingStrategy.renderView(FaceletViewHandlingStrategy.java:418) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.application.view.MultiViewHandler.renderView(MultiViewHandler.java:131) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:121) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139) [jsf-impl-2.1.3-b02-jbossorg-2.jar:2.1.3-SNAPSHOT] at javax.faces.webapp.FacesServlet.service(FacesServlet.java:594) [jboss-jsf-api_2.1_spec-2.0.0.Beta1.jar:2.0.0.Beta1] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.modcluster.catalina.CatalinaContext$RequestListenerValve.event(CatalinaContext.java:285) at org.jboss.modcluster.catalina.CatalinaContext$RequestListenerValve.invoke(CatalinaContext.java:261) at org.jboss.as.web.session.ClusteredSessionValve.handleRequest(ClusteredSessionValve.java:123) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:89) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.JvmRouteValve.invoke(JvmRouteValve.java:88) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.LockingValve.invoke(LockingValve.java:56) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.handleRequest(ClusteredSessionValve.java:123) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:89) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.JvmRouteValve.invoke(JvmRouteValve.java:88) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.session.LockingValve.invoke(LockingValve.java:56) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:155) [jboss-as-web-7.1.0.Alpha2-SNAPSHOT.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:362) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930) [jbossweb-7.0.3.Final.jar:7.1.0.Alpha2-SNAPSHOT] at java.lang.Thread.run(Thread.java:662) [:1.6.0_24] 17:13:51,907 ERROR [org.infinispan.remoting.ReplicationQueue] (Scheduled-replicationQueue-thread-0) ISPN000072: Failed replicating 1 elements in replication queue: org.infinispan.CacheException: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.util.Util.rewrapAsCacheException(Util.java:535) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:114) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:406) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:130) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:158) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.ReplicationQueueImpl.flush(ReplicationQueueImpl.java:159) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.ReplicationQueueImpl$1.run(ReplicationQueueImpl.java:112) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) [:1.6.0_24] at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) [:1.6.0_24] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180) [:1.6.0_24] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204) [:1.6.0_24] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [:1.6.0_24] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [:1.6.0_24] at java.lang.Thread.run(Thread.java:662) [:1.6.0_24] Caused by: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.marshallCall(CommandAwareRpcDispatcher.java:213) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:234) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:110) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] ... 14 more Caused by: org.infinispan.CacheException: Unable to marshall value AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3} at org.infinispan.marshall.MarshalledValue.serialize0(MarshalledValue.java:129) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.MarshalledValue.serialize(MarshalledValue.java:97) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.MarshalledValue.getRaw(MarshalledValue.java:206) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.MarshalledValue$Externalizer.writeObject(MarshalledValue.java:318) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.MarshalledValue$Externalizer.writeObject(MarshalledValue.java:309) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandParameters(ReplicableCommandExternalizer.java:83) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:68) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:56) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandParameters(ReplicableCommandExternalizer.java:83) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.marshallParameters(CacheRpcCommandExternalizer.java:123) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:110) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:66) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandParameters(ReplicableCommandExternalizer.java:83) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.marshallParameters(CacheRpcCommandExternalizer.java:123) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:110) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:66) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectToObjectStream(AbstractJBossMarshaller.java:59) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.VersionAwareMarshaller.objectToBuffer(VersionAwareMarshaller.java:91) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.AbstractMarshaller.objectToBuffer(AbstractMarshaller.java:57) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.AbstractDelegatingMarshaller.objectToBuffer(AbstractDelegatingMarshaller.java:85) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.MarshallerAdapter.objectToBuffer(MarshallerAdapter.java:45) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.marshallCall(CommandAwareRpcDispatcher.java:211) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] ... 16 more Caused by: java.lang.NullPointerException at java.util.LinkedHashMap$LinkedHashIterator.<init>(LinkedHashMap.java:346) [:1.6.0_24] at java.util.LinkedHashMap$LinkedHashIterator.<init>(LinkedHashMap.java:345) [:1.6.0_24] at java.util.LinkedHashMap$EntryIterator.<init>(LinkedHashMap.java:391) [:1.6.0_24] at java.util.LinkedHashMap$EntryIterator.<init>(LinkedHashMap.java:391) [:1.6.0_24] at java.util.LinkedHashMap.newEntryIterator(LinkedHashMap.java:398) [:1.6.0_24] at java.util.HashMap$EntrySet.iterator(HashMap.java:950) [:1.6.0_24] at java.util.AbstractMap.hashCode(AbstractMap.java:459) [:1.6.0_24] at java.util.HashMap$Entry.hashCode(HashMap.java:720) [:1.6.0_24] at java.util.AbstractMap.hashCode(AbstractMap.java:461) [:1.6.0_24] at org.jboss.as.clustering.SimpleMarshalledValue.hashCode(SimpleMarshalledValue.java:104) at org.jboss.marshalling.TraceInformation.addObjectInformation(TraceInformation.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:125) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.MarshallUtil.marshallMap(MarshallUtil.java:60) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.MapExternalizer.writeObject(MapExternalizer.java:63) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.exts.MapExternalizer.writeObject(MapExternalizer.java:47) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.atomic.AtomicHashMap$Externalizer.writeObject(AtomicHashMap.java:225) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.atomic.AtomicHashMap$Externalizer.writeObject(AtomicHashMap.java:222) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.jboss.ExternalizerTable$ExternalizerAdapter.writeObject(ExternalizerTable.java:389) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:145) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:62) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:119) [jboss-marshalling-1.3.4.GA.jar:1.3.4.GA] at org.infinispan.marshall.jboss.AbstractJBossMarshaller.objectToObjectStream(AbstractJBossMarshaller.java:59) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.VersionAwareMarshaller.objectToObjectStream(VersionAwareMarshaller.java:151) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.AbstractDelegatingMarshaller.objectToObjectStream(AbstractDelegatingMarshaller.java:40) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] at org.infinispan.marshall.MarshalledValue.serialize0(MarshalledValue.java:112) [infinispan-core-5.1.0.BETA2.jar:5.1.0.BETA2] ... 53 more Caused by: an exception which occurred: in object org.infinispan.util.FastCopyHashMap@3bcbbcb3 -> toString = org.infinispan.util.FastCopyHashMap@3bcbbcb3 in object org.infinispan.atomic.AtomicHashMap@741ad263 -> toString = AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3} in object org.infinispan.marshall.MarshalledValue@741ad263 -> toString = MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3}, serialized=false, cachedHashCode=1947914851}@3cd1aa70 in object org.infinispan.commands.write.PutKeyValueCommand@a29effde -> toString = PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=ByteArray{size=185, array=[3, 1, -2, 4, 9, 0, 0, 0, 84, 111, ..]}, cachedHashCode=377866657}@10c03c6, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3}, serialized=false, cachedHashCode=1947914851}@3cd1aa70, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1} in object org.infinispan.commands.tx.PrepareCommand@1e6326a5 -> toString = PrepareCommand {gtx=GlobalTransaction:<node1/web>:10:local, modifications=[PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=ByteArray{size=185, array=[3, 1, -2, 4, 9, 0, 0, 0, 84, 111, ..]}, cachedHashCode=377866657}@10c03c6, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3}, serialized=false, cachedHashCode=1947914851}@3cd1aa70, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}, PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=false, cachedHashCode=377866657}@439ed348, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@70413ea6}, serialized=false, cachedHashCode=0}@4b783ddd, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}, PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=false, cachedHashCode=377866657}@5ae1a690, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@147e668d}, serialized=false, cachedHashCode=0}@767ebd7d, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}], onePhaseCommit=true, gtx=GlobalTransaction:<node1/web>:10:local, cacheName='repl'} in object org.infinispan.commands.remote.MultipleRpcCommand@ae370d2b -> toString = MultipleRpcCommand{commands=[PrepareCommand {gtx=GlobalTransaction:<node1/web>:10:local, modifications=[PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=ByteArray{size=185, array=[3, 1, -2, 4, 9, 0, 0, 0, 84, 111, ..]}, cachedHashCode=377866657}@10c03c6, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@3bcbbcb3}, serialized=false, cachedHashCode=1947914851}@3cd1aa70, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}, PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=false, cachedHashCode=377866657}@439ed348, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@70413ea6}, serialized=false, cachedHashCode=0}@4b783ddd, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}, PutKeyValueCommand{key=MarshalledValue{instance=//default-host/null/BYXH2GtlUjjBVaeFEPcmNYU+, serialized=false, cachedHashCode=377866657}@5ae1a690, value=MarshalledValue{instance=AtomicHashMap{delegate=org.infinispan.util.FastCopyHashMap@147e668d}, serialized=false, cachedHashCode=0}@767ebd7d, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1}], onePhaseCommit=true, gtx=GlobalTransaction:<node1/web>:10:local, cacheName='repl'}], cacheName='repl'} {noformat}