[jboss-user] [JBoss Messaging] - Re: MDBs not getting messages after long run

[mpr_prabhu]

We had the same problem occur few times today.
When the problem occurred we just stopped the delivery on the MDB MBean and started delivery again. Everything started working again.

Also when the problem occurred we took a  ThreadCPUUtilization to see what threads were doing any work and found a daemon thread which was the only one using CPU cycles.
The thread dump (before we started re-delivery of messages to MDBs again) of this thread during this period showed
Few times we caught the thread doing this 

Thread: Thread-78 : priority:5, demon:true, threadId:328, threadState:RUNNABLE, lockName:nulljava.net.SocketInputStream.socketRead0(Native Method)java.net.SocketInputStream.read(SocketInputStream.java:129)java.io.BufferedInputStream.fill(BufferedInputStream.java:218)java.io.BufferedInputStream.read(BufferedInputStream.java:235)java.io.FilterInputStream.read(FilterInputStream.java:66)org.jboss.remoting.transport.socket.MicroSocketClientInvoker.readVersion(MicroSocketClientInvoker.java:1000)org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:574)org.jboss.remoting.transport.bisocket.BisocketClientInvoker.transport(BisocketClientInvoker.java:413)org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:122)org.jboss.remoting.Client.invoke(Client.java:1634)org.jboss.remoting.Client.invoke(Client.java:548)org.jboss.remoting.Client.invoke(Client.java:536)org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:187)org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:158)org.jboss.jms.client.delegate.ClientSessionDelegate.org$jboss$jms$client$delegate$ClientSessionDelegate$acknowledgeDeliveries$aop(ClientSessionDelegate.java:175)org.jboss.jms.client.delegate.ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.invokeNext(ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.java)org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:92)org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)org.jboss.jms.client.delegate.ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.invokeNext(ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.java)org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)org.jboss.jms.client.delegate.ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.invokeNext(ClientSessionDelegate$acknowledgeDeliveries_1767561430588382789.java)org.jboss.jms.client.delegate.ClientSessionDelegate.acknowledgeDeliveries(ClientSessionDelegate.java)org.jboss.jms.client.container.SessionAspect.acknowledgeDeliveries(SessionAspect.java:908)org.jboss.jms.client.container.SessionAspect.handleAcknowledgeAll(SessionAspect.java:399)org.jboss.aop.advice.org.jboss.jms.client.container.SessionAspect20.invoke(SessionAspect20.java)org.jboss.jms.client.delegate.ClientSessionDelegate$acknowledgeAll_3428828241771477154.invokeNext(ClientSessionDelegate$acknowledgeAll_3428828241771477154.java)org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)org.jboss.jms.client.delegate.ClientSessionDelegate$acknowledgeAll_3428828241771477154.invokeNext(ClientSessionDelegate$acknowledgeAll_3428828241771477154.java)org.jboss.jms.client.delegate.ClientSessionDelegate.acknowledgeAll(ClientSessionDelegate.java)org.jboss.jms.message.MessageProxy.acknowledge(MessageProxy.java:426)org.jboss.messaging.core.impl.clusterconnection.MessageSucker.onMessage(MessageSucker.java:300)org.jboss.jms.client.container.ClientConsumer.callOnMessage(ClientConsumer.java:157)org.jboss.jms.client.container.ClientConsumer$ListenerRunner.run(ClientConsumer.java:965)EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:89)java.lang.Thread.run(Thread.java:595)


Once the thread was doing
Thread: Thread-78 : priority:5, demon:true, threadId:328, threadState:RUNNABLE, lockName:nulljava.net.SocketInputStream.socketRead0(Native Method)java.net.SocketInputStream.read(SocketInputStream.java:129)java.io.BufferedInputStream.fill(BufferedInputStream.java:218)java.io.BufferedInputStream.read(BufferedInputStream.java:235)java.io.FilterInputStream.read(FilterInputStream.java:66)org.jboss.remoting.transport.socket.MicroSocketClientInvoker.readVersion(MicroSocketClientInvoker.java:1000)org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:574)org.jboss.remoting.transport.bisocket.BisocketClientInvoker.transport(BisocketClientInvoker.java:413)org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:122)org.jboss.remoting.Client.invoke(Client.java:1634)org.jboss.remoting.Client.invoke(Client.java:548)org.jboss.remoting.Client.invoke(Client.java:536)org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:187)org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:158)org.jboss.jms.client.delegate.ClientSessionDelegate.org$jboss$jms$client$delegate$ClientSessionDelegate$cancelDelivery$aop(ClientSessionDelegate.java:493)org.jboss.jms.client.delegate.ClientSessionDelegate$cancelDelivery_2980985335510575813.invokeNext(ClientSessionDelegate$cancelDelivery_2980985335510575813.java)org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:92)org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)org.jboss.jms.client.delegate.ClientSessionDelegate$cancelDelivery_2980985335510575813.invokeNext(ClientSessionDelegate$cancelDelivery_2980985335510575813.java)org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:105)org.jboss.jms.client.delegate.ClientSessionDelegate$cancelDelivery_2980985335510575813.invokeNext(ClientSessionDelegate$cancelDelivery_2980985335510575813.java)org.jboss.jms.client.delegate.ClientSessionDelegate.cancelDelivery(ClientSessionDelegate.java)org.jboss.jms.client.container.ClientConsumer.checkExpiredOrReachedMaxdeliveries(ClientConsumer.java:103)org.jboss.jms.client.container.ClientConsumer.callOnMessage(ClientConsumer.java:132)org.jboss.jms.client.container.ClientConsumer$ListenerRunner.run(ClientConsumer.java:965)EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:89)java.lang.Thread.run(Thread.java:595)


Any idea what is going on?
We use DUPS_OK_ACKNOWLEDGE mode for the MDBs. Does this have anything to do with these or something going on with the clustering?







View the original post : http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4134437#4134437

Reply to the post : http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&p=4134437