[JBoss JIRA] Created: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
4:50 p.m.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public (Everyone can see)
Affects Versions: 2.2.2.SP11, 2.2.2.SP10, 2.2.2.SP9, 2.2.2.SP8, 2.2.2.SP7, 2.2.2.SP5,
2.2.2.SP4, 2.2.2.GA_CP03, 2.2.2.GA_CP02, 2.2.2.SP2, 2.2.2.SP1, 2.2.2.GA_CP01, 2.2.2.GA,
2.2.1.GA, 2.2.0.SP4, 2.2.0.SP3, 2.2.0.SP2, 2.2.0.SP1, 2.2.0.GA (Bluto)
Reporter: Galder Zamarreño
Priority: Critical
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast to
classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
4:56 p.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño updated JBREM-1127:
------------------------------------
Attachment: jbrem1127.zip
server.log
Attached modified source code to add more logging and server.log with issue reproduced.
Note that in the server.log, the very 1st run works fine but this is only due to lack of
thread safety in MicroRemoteClientInvoker that allows two unmarshallers to be created:
2009-05-04 16:31:01,038 28454 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50921]:) New unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@cdf3c2 with classloader
org.jboss.remoting.loading.RemotingClassLoader@1689405
...
2009-05-04 16:31:01,038 28454 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#0[127.0.0.2:50922]:) New unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@1cbc39b with classloader
org.jboss.remoting.loading.RemotingClassLoader@11261b1
In that case, each will have a diff unmarshaller and classloader passed down, so it works
fine.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Priority: Critical
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
3:48 p.m.
New subject: [JBoss JIRA] Assigned: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Jay Howell reassigned JBREM-1127:
---------------------------------
Assignee: Ron Sigal
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
7:58 a.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal updated JBREM-1127:
-----------------------------
Fix Version/s: 2.2.2.SP12
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.2.SP12
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
6:12 a.m.
New subject: [JBoss JIRA] Closed: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal closed JBREM-1127.
----------------------------
Resolution: Done
The problem is solved by Galder's suggestion. To get the correct behavior, it is
necessary to set the parameter org.jboss.remoting.Remoting.USE_CURRENT_THREAD_CLASS_LOADER
(actual value "useCurrentThreadClassLoader") to "true". In that case,
org.jboss.remoting.MicroRemoteClientInvoker.invoke() will pass null where it would
otherwise the current thread context classloader to the
org.jboss.remoting.loading.RemotingClassLoader constructor. When
RemotingClassLoader.loadClass() sees null, it use the current thread context classloader.
Unit test:
org.jboss.test.remoting.classloader.currentthread.CurrentThreadContextClassLoaderTestCase.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.2.SP12
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:57 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
Just verified and the issue is still present. For my suggestion to work, as mentioned
above, you have to somehow remove the caching and always generate a classloader.
You're then for sure to use the correct classloader, otherwise the following occurrs:
1.- 1st invocation:
server.log:12431:2009-05-13 09:52:02,058 32527 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:52476]:)
SocketClientInvoker[13b64eb, socket://lo3:3873](1) invoking InvocationRequest[110b205,
AOP, [advisedMethod=public abstract classcastexceptiontest.process.ResponseMsg
classcastexceptiontest.process.Process.doProcess(classcastexceptiontest.process.RequestMsg),
unadvisedMethod=public abstract classcastexceptiontest.process.ResponseMsg
classcastexceptiontest.process.Process.doProcess(classcastexceptiontest.process.RequestMsg),
metadata=[metaData={DISPATCHER={OID=[type=AS_ISvalue=jboss.j2ee:ear=process.ear,jar=process.jar,name=ProcessImpl,service=EJB3]},
REMOTING={SUBSYSTEM=[type=AS_ISvalue=AOP], INVOKER_LOCATOR=[type=AS_ISvalue=InvokerLocator
[socket://lo3:3873/?useCurrentThreadClassLoader=true]]},
IS_LOCAL={GUID=[type=AS_ISvalue=jboss.j2ee:ear=process.ear,jar=process.jar,name=ProcessImpl,service=EJB3,VMID=11d1def534ea1be0:1bfd48ec:12138f4878a:-7ffd]},
TransactionPropagationContext={TransactionPropagationContext=[type=MARSHALLEDvalue=7f000001:8dbe:4a0a7c03:ac]}}],
targetObject=null, arguments=[Ljava.lang.Object;@1178281]]
2.- Option set:
server.log:12434:2009-05-13 09:52:02,058 32527 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:52476]:) Using
useCurrentThreadClassLoader=true
3.- New unmarshaller created that caches the classloader:
server.log:12437:2009-05-13 09:52:02,058 32527 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:52476]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@1dfe453 with classloader
org.jboss.remoting.loading.RemotingClassLoader@73b72
4.- 2nd invocation, to a different ear:
server.log:12482:2009-05-13 09:52:02,068 32537 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#1[127.0.0.2:52477]:)
SocketClientInvoker[13b64eb, socket://lo3:3873](1) invoking InvocationRequest[b04589, AOP,
[advisedMethod=public abstract classcastexceptiontest.process.ResponseMsg
classcastexceptiontest.process.Process.doProcess(classcastexceptiontest.process.RequestMsg),
unadvisedMethod=public abstract classcastexceptiontest.process.ResponseMsg
classcastexceptiontest.process.Process.doProcess(classcastexceptiontest.process.RequestMsg),
metadata=[metaData={DISPATCHER={OID=[type=AS_ISvalue=jboss.j2ee:ear=process.ear,jar=process.jar,name=ProcessImpl,service=EJB3]},
REMOTING={SUBSYSTEM=[type=AS_ISvalue=AOP], INVOKER_LOCATOR=[type=AS_ISvalue=InvokerLocator
[socket://lo3:3873/?useCurrentThreadClassLoader=true]]},
IS_LOCAL={GUID=[type=AS_ISvalue=jboss.j2ee:ear=process.ear,jar=process.jar,name=ProcessImpl,service=EJB3,VMID=11d1def534ea1be0:1bfd48ec:12138f4878a:-7ffd]},
TransactionPropagationContext={TransactionPropagationContext=[type=MARSHALLEDvalue=7f000001:8dbe:4a0a7c03:ad]}}],
targetObject=null, arguments=[Ljava.lang.Object;@a553e2]]
5.- Uses cached marshaller that contains the wrong classloader:
server.log:12483:2009-05-13 09:52:02,068 32537 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#1[127.0.0.2:52477]:)
Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@1dfe453
6.- 2nd request fails:
2009-05-13 09:52:02,192 32661 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker1] (WorkerThread#0[127.0.0.2:52476]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast to
classcastexceptiontest.process.ResponseMsg
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:59 a.m.
New subject: [JBoss JIRA] Reopened: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño reopened JBREM-1127:
-------------------------------------
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:10 a.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño updated JBREM-1127:
------------------------------------
Attachment: patch.txt
Find attached a patch that solves the issue
It's the caching that is messing things up. I've used the newly created
useCurrentThreadClassLoader option (could be renamed to something else), to always create
a marshaller/unmarshaller and to avoid caching. The result is that the issue is fixed as
each thread creates the right unmarshaller with the right classloader.
Ron, if you need access to the test case and set up, let me know and I'll email it to
you. Can't attach it to the case cos it's not mine :)
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:10 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Thanks for checking it out, Galder.
I don't understand why it doesn't work, though. The cached unmarshaller, with its
org.jboss.remoting.loading.RemotingClassLoader@73b72, should be using the *current* thread
context classloader. I'll have to look again.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:18 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Ah, maybe here's the explanation. The default behavior in
MicroRemoteClientInvoker.invoke(), is to use ClassByteClassLoader first, then the thread
context classloader. If you set "classloadingParentFirstDelegation" to
"false", it will use the thread context classloader first. Not sure ... .
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:37 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
Just tried that and made no difference.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:03 p.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal updated JBREM-1127:
-----------------------------
Attachment: stacktrace-051409
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:07 p.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Hey, Galder, I'm confused. I've been running your example, and I get the stack
trace in the attached file stacktrace-051409. It looks to me like the CCE is occurring
during the JNDI lookup:
[junit] Caused by: javax.naming.CommunicationException [Root exception is
java.io.InvalidClassException: org.jboss.ejb3.remoting.BaseRemoteProxy; local class
incompatible: stream classdesc serialVersionUID = -2711693270411201590, local class
serialVersionUID = 1126421850898582900]
[junit] at org.jnp.interfaces.NamingContext.lookup(NamingContext.java:780)
[junit] at org.jnp.interfaces.NamingContext.lookup(NamingContext.java:627)
[junit] at javax.naming.InitialContext.lookup(InitialContext.java:351)
[junit] at classcastexceptiontest.jndi.JndiLookupUtil.getEJB(JndiLookupUtil.java:33)
[junit] at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:48)
MicroRemoteClientInvoker appears in the trace, but that's because it injects the trace
it gets back from the server into its own stack trace. In other words, it doesn't
look like a Remoting problem, at least in this example. Not that I dispute that
there's a related Remoting problem. Now, I'm confused about the fact that you say
that your patch fixed the problem. In fact, I got the attached stack trace with your
patch applied. Of course, I could have made a mistake in setting up the test.
I don't know. WDYT?
-Ron
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
8:25 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
You seem to be using a different EAP/AS version to the one for which the client libraries
have been provided.
I've been testing against EAP 4.3.0.GA_CP04 and you?
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
8:38 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
I was using EAP 4.3.0.GA_CP02 and AS 4.2.2.GA, two versions I already had sitting around
on two different machines. Does it matter?
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
8:40 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
Shouldn't but try with CP04 please. Export and build:
http://anonsvn.jboss.org/repos/jbossas/tags/JBPAPP_4_3_0_GA_CP04/
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:06 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Ok, I'll download tonight and re-run tomorrow.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:53 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Hi Galder,
I have now installed EAP 4.3.0.GA_CP04 on two machines and re-run the example, and it
works. Here's the client output:
Buildfile:
/NotBackedUp/rsigal/JBoss/Remoting/jbrem-1127/jboss-class-cast-exception-test/build.xml
init:
[copy] Copying 1 file to
/NotBackedUp/rsigal/JBoss/Remoting/jbrem-1127/jboss-class-cast-exception-test/out/conf
[copy] Copying 6 files to
/NotBackedUp/rsigal/JBoss/Remoting/jbrem-1127/jboss-class-cast-exception-test/out/conf/ejb
compile.intf:
compile.main:
compile.test:
compile.all:
test.concurrentprocessinvoke:
[junit] 0 [main] DEBUG classcastexceptiontest.processinvoker.ConcurrentProcessInvoke
- START concurrentProcessInvoke() ...
[junit] 10 [ProcessInvoker1] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker1Test - START testInvokeProcess()
...
[junit] 11 [ProcessInvoker1] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker1Test - host: rsigal.csb/127.0.0.1
[junit] 15 [ProcessInvoker2] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker2Test - START testInvokeProcess()
...
[junit] 15 [ProcessInvoker2] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker2Test - host: rsigal.csb/127.0.0.1
[junit] 296 [ProcessInvoker1] DEBUG classcastexceptiontest.jndi.JndiLookupUtil - got
EJB from naming context
jboss.j2ee:ear=processinvoker1.ear,jar=processinvoker1.jar,name=ProcessInvoker1,service=EJB3
[junit] 359 [ProcessInvoker1] DEBUG org.jboss.security.SecurityAssociation - Using
ThreadLocal: false
[junit] 375 [ProcessInvoker2] DEBUG classcastexceptiontest.jndi.JndiLookupUtil - got
EJB from naming context
jboss.j2ee:ear=processinvoker2.ear,jar=processinvoker2.jar,name=ProcessInvoker2,service=EJB3
[junit] 570 [ProcessInvoker2] DEBUG
org.jboss.remoting.transport.socket.MicroSocketClientInvoker -
SocketClientInvoker[164b09c, socket://192.168.2.2:3873] constructed
[junit] 572 [ProcessInvoker2] DEBUG org.jboss.remoting.MicroRemoteClientInvoker -
SocketClientInvoker[164b09c, socket://192.168.2.2:3873] connecting
[junit] 572 [ProcessInvoker2] DEBUG
org.jboss.remoting.transport.socket.MicroSocketClientInvoker - Creating semaphore with
size 50
[junit] 575 [ProcessInvoker2] DEBUG org.jboss.remoting.MicroRemoteClientInvoker -
SocketClientInvoker[164b09c, socket://192.168.2.2:3873] connected
[junit] 609 [ProcessInvoker2] DEBUG
org.jboss.remoting.transport.socket.ClientSocketWrapper - reset timeout: 0
[junit] 617 [ProcessInvoker1] DEBUG
org.jboss.remoting.transport.socket.ClientSocketWrapper - reset timeout: 0
[junit] 896 [ProcessInvoker2] DEBUG org.jboss.remoting.InvokerRegistry - decremented
SocketClientInvoker[164b09c, socket://192.168.2.2:3873]'s count, current count 1
[junit] 897 [ProcessInvoker1] DEBUG org.jboss.remoting.InvokerRegistry - removed
SocketClientInvoker[164b09c, socket://192.168.2.2:3873] from registry
[junit] 898 [ProcessInvoker1] DEBUG
org.jboss.remoting.transport.socket.MicroSocketClientInvoker -
SocketClientInvoker[164b09c, socket://192.168.2.2:3873] disconnecting ...
[junit] 899 [ProcessInvoker1] DEBUG org.jboss.remoting.transport.socket.SocketWrapper
- ClientSocketWrapper[Socket[addr=/192.168.2.2,port=3873,localport=41497].1c9e67a]
closing
[junit] 900 [ProcessInvoker1] DEBUG org.jboss.remoting.transport.socket.SocketWrapper
- ClientSocketWrapper[Socket[addr=/192.168.2.2,port=3873,localport=41498].3a5794] closing
[junit] 905 [ProcessInvoker2] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker2Test - Process response:
[junit] Request(2009-05-17 03:49:28:728): ProcessInvoker2
[junit] Response(2009-05-17 03:49:28:729): Done
[junit] 906 [ProcessInvoker2] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker2Test - END testInvokeProcess()
[junit] 905 [ProcessInvoker1] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker1Test - Process response:
[junit] Request(2009-05-17 03:49:28:728): ProcessInvoker1
[junit] Response(2009-05-17 03:49:28:729): Done
[junit] 908 [ProcessInvoker1] DEBUG
classcastexceptiontest.processinvoker.ProcessInvoker1Test - END testInvokeProcess()
[junit] 908 [main] DEBUG classcastexceptiontest.processinvoker.ConcurrentProcessInvoke
- END concurrentProcessInvoke()
BUILD SUCCESSFUL
Total time: 1 second
Here's the EJB3 Connector MBean:
<mbean code="org.jboss.remoting.transport.Connector"
name="jboss.remoting:type=Connector,name=DefaultEjb3Connector,handler=ejb3">
<depends>jboss.aop:service=AspectDeployer</depends>
<attribute
name="InvokerLocator">socket://${jboss.bind.address}:3873/?useCurrentThreadClassLoader=true&classloadingParentFirstDelegation=false</attribute>
<attribute name="Configuration">
<handlers>
<handler
subsystem="AOP">org.jboss.aspects.remoting.AOPRemotingInvocationHandler</handler>
</handlers>
</attribute>
</mbean>
Galder, do you want to try again?
-Ron
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:46 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
Ron, still fails for me. Can you try repeating the same test several times and see if it
fails?
I'm using the jar you attached to this case:
https://enterprise.redhat.com/issue-tracker/290590
Did you modify the code since you attached that jar?
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:38 a.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal updated JBREM-1127:
-----------------------------
Attachment: jboss-remoting.jar
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jbrem1127.zip, patch.txt, server.log,
stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:38 a.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Hi Galder,
Ok, I used your idea (cache or don't cache) plus I tracked down a couple of places
where the classloader was too "sticky". Try the attached jboss-remoting.jar
-Ron
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jbrem1127.zip, patch.txt, server.log, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
1:21 p.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño updated JBREM-1127:
------------------------------------
Attachment: server.logs.1905.zip
Ron, still no luck. I've replace jboss-remoting in client/, and lib/ folders of two
servers and still does not work:
Both servers have:
<mbean code="org.jboss.remoting.transport.Connector"
name="jboss.remoting:type=Connector,name=DefaultEjb3Connector,handler=ejb3">
<depends>jboss.aop:service=AspectDeployer</depends>
<attribute
name="InvokerLocator">socket://${jboss.bind.address}:3873/?useCurrentThreadClassLoader=true&classloadingParentFirstDelegation=false</attribute>
<attribute name="Configuration">
<handlers>
<handler
subsystem="AOP">org.jboss.aspects.remoting.AOPRemotingInvocationHandler</handler>
</handlers>
</attribute>
</mbean>
Try running it a couple of times, the 2nd time always fails. The first time sometimes.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jbrem1127.zip, patch.txt, server.log,
server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:32 p.m.
New subject: [JBoss JIRA] Updated: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal updated JBREM-1127:
-----------------------------
Attachment: jboss-remoting.jar
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jboss-remoting.jar, jbrem1127.zip, patch.txt,
server.log, server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:42 p.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
I've been running the test 10 times in a row, without any problem. However, I
downloaded the jboss-remoting.jar I attached last night, and, with that jar, the test
failed. I guess I must have uploaded the wrong jar, though I don't know how.
So, I uploaded the right jar, downloaded it, put it in the client and server directories,
and ran the test 10 times without a problem.
Could you try again?
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jboss-remoting.jar, jbrem1127.zip, patch.txt,
server.log, server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
6:55 p.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Galder Zamarreño commented on JBREM-1127:
-----------------------------------------
Yeah, that works fine now :)
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jboss-remoting.jar, jbrem1127.zip, patch.txt,
server.log, server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
7:52 p.m.
New subject: [JBoss JIRA] Commented: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal commented on JBREM-1127:
----------------------------------
Excellent!
I'll get this into release 2.2.3 for the next EAP CP release. Is that too late?
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jboss-remoting.jar, jbrem1127.zip, patch.txt,
server.log, server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
9:12 p.m.
New subject: [JBoss JIRA] Closed: (JBREM-1127) ClassCastExceptions arising from Unmarsharller/Classloader caching in MicroRemoteClientInvoker
[
https://jira.jboss.org/jira/browse/JBREM-1127?page=com.atlassian.jira.plu...
]
Ron Sigal closed JBREM-1127.
----------------------------
Resolution: Done
I'm going to try closing this one again.
ClassCastExceptions arising from Unmarsharller/Classloader caching in
MicroRemoteClientInvoker
----------------------------------------------------------------------------------------------
Key: JBREM-1127
URL: https://jira.jboss.org/jira/browse/JBREM-1127
Project: JBoss Remoting
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 2.2.0.GA (Bluto), 2.2.0.SP1, 2.2.0.SP2, 2.2.0.SP3, 2.2.0.SP4,
2.2.1.GA, 2.2.2.GA, 2.2.2.GA_CP01, 2.2.2.SP1, 2.2.2.SP2, 2.2.2.GA_CP02, 2.2.2.GA_CP03,
2.2.2.SP4, 2.2.2.SP5, 2.2.2.SP7, 2.2.2.SP8, 2.2.2.SP9, 2.2.2.SP10, 2.2.2.SP11
Reporter: Galder Zamarreño
Assignee: Ron Sigal
Priority: Critical
Fix For: 2.2.3
Attachments: jboss-remoting.jar, jboss-remoting.jar, jbrem1127.zip, patch.txt,
server.log, server.logs.1905.zip, stacktrace-051409
Classloading when accessing a remote bean from within 2 separate isolated EARs in AS is
broken.
Let's say you have a bean, A, deployed in node2 and this bean is accessed from two
isolated EARs in node1 and this bean returns a instance of Foo. If you run paralell
requests to these two separate EARs, you'll randomly get ClassCastExceptions. This is
due to these two isolated EARs could potentially be using the same
MicroRemoteClientInvoker instance, and hence the same unmarshaller. So, you could easily
get this situation:
1. Invocation for bean A is proxied through isolated EAR-1 in node1. A new client invoker
is created.
2009-05-04 16:31:04,489 31905 DEBUG
[org.jboss.remoting.transport.socket.MicroSocketClientInvoker]
(WorkerThread#0[127.0.0.2:50932]:) SocketClientInvoker[5e5f92, socket://lo3:3873]
constructed
... // new logged line below
server.log:12767:2009-05-04 16:31:04,489 31905 TRACE
[org.jboss.remoting.MicroRemoteClientInvoker] (WorkerThread#0[127.0.0.2:50932]:) New
unmarshaller set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8 with classloader
org.jboss.remoting.loading.RemotingClassLoader@10f3801
2. Loads Foo (or in this case ResponseMsg from EAR-1):
2009-05-04 16:31:04,534 31950 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Calling
Class.forName(classcastexceptiontest.process.ResponseMsg, false,
org.jboss.remoting.loading.RemotingClassLoader@10f3801)
2009-05-04 16:31:04,535 31951 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#0[127.0.0.2:50932]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
2. Invocation for bean B is proxied through isolated EAR-2 in node1. A cached invoker is
used:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.InvokerRegistry]
(WorkerThread#1[127.0.0.2:50931]:) Found and returning cached client invoker
(SocketClientInvoker[5e5f92, socket://lo3:3873])
And the unrmarshaller is already set with the wrong classloader!!:
2009-05-04 16:31:04,516 31932 TRACE [org.jboss.remoting.MicroRemoteClientInvoker]
(WorkerThread#1[127.0.0.2:50931]:) Unmarshaller is already set to
org.jboss.remoting.marshal.serializable.SerializableUnMarshaller@2606b8
3. So, with the wrong classloader, it loads Foo (or ResponseMsg) from EAR-1 again when it
should have loaded it from EAR-2:
2009-05-04 16:31:04,524 31940 TRACE
[org.jboss.remoting.loading.ObjectInputStreamWithClassLoader]
(WorkerThread#1[127.0.0.2:50931]:) Resolved class
classcastexceptiontest.process.ResponseMsg.ClassLoader=org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.UnifiedClassLoader3@1d4f279{
url=file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear
,addedOrder=37}
..org.jboss.mx.loading.HeirarchicalLoaderRepository3$NoParentClassLoader@1178281
..org.jboss.system.server.NoAnnotationURLClassLoader@1e4457d
..sun.misc.Launcher$AppClassLoader@17182c1
....file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/bin/run.jar
....file:/usr/java/jdk1.6.0_12/lib/tools.jar
..sun.misc.Launcher$ExtClassLoader@13f5d07
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/dnsns.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunjce_provider.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/localedata.jar
....file:/usr/java/jdk1.6.0_12/jre/lib/ext/sunpkcs11.jar
++++CodeSource:
(file:/home/galder/jboss/code/eap/4.3.0.ga.cp04/build/output/jboss-4.3.0.GA_CP04/server/290590_1/tmp/deploy/tmp4913079009040294654processinvoker1.ear-contents/process-intf.jar
<no signer certificates>)
Implemented Interfaces:
++interface java.io.Serializable
++++ClassLoader: null
++++Null CodeSource
4. Result is a CCE:
2009-05-04 16:31:04,525 31941 ERROR
[classcastexceptiontest.processinvoker.ProcessInvoker2] (WorkerThread#1[127.0.0.2:50931]:)
Caught exception
java.lang.ClassCastException: classcastexceptiontest.process.ResponseMsg cannot be cast
to classcastexceptiontest.process.ResponseMsg
at $Proxy74.doProcess(Unknown Source)
at
classcastexceptiontest.processinvoker.ProcessInvoker2.invokeProcess(ProcessInvoker2.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:112)
at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:57)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:191)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:94)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:70)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.aspects.security.AuthenticationInterceptor.invoke(AuthenticationInterceptor.java:77)
at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptor.invoke(Ejb3AuthenticationInterceptor.java:108)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
at
org.jboss.ejb3.stateless.StatelessContainer.dynamicInvoke(StatelessContainer.java:280)
at org.jboss.aop.Dispatcher.invoke(Dispatcher.java:106)
at
org.jboss.aspects.remoting.AOPRemotingInvocationHandler.invoke(AOPRemotingInvocationHandler.java:82)
at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:866)
at
org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:608)
at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:406)
at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:173)
How to resolve this?
At first glance, the most trivial thing to do is to have an unmarshaller that simply uses
whatever Thread.currentThread().getContextClassLoader() is set to, rather than being
caching unmarshaller and classloaders.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
5602
days inactive
5617
days old
26 comments
3 participants
participants (3)
-
Galder Zamarreño (JIRA) -
Jay Howell (JIRA)
-
Ron Sigal (JIRA)