[JBoss JIRA] Created: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[JBoss JIRA] Created:...

Richard Kennard (JIRA)

Monday, 10 August 2009 Mon, 10 Aug '09

11:43 a.m.

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Tim Fox I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

Show replies by date

Tim Fox (JIRA)

Monday, 10 August Mon, 10 Aug

11:53 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Tim Fox commented on JBMESSAGING-1706: --------------------------------------

...

From what I have seen of this JBoss Messaging *does not* throw a HeuristicMixedException.

Let's look at the stack trace again: javax.transaction.HeuristicMixedException at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate (TransactionImple.java:1431) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction .java:137) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDeleg ate.java:75) at org.jboss.resource.adapter.jms.inflow.JmsServerSession$XATransactionDemarcationStrategy.e nd(JmsServerSession.java:657) at org.jboss.resource.adapter.jms.inflow.JmsServerSession.run(JmsServerSession.java:243) at org.jboss.resource.work.WorkWrapper.execute(WorkWrapper.java:205) at org.jboss.util.threadpool.BasicTaskWrapper.run(BasicTaskWrapper.java:260) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619) The exception is being thrown from com.arjuna classes. (Arjuna is the old name for what is now known as JBoss Transactions). The classes that begin with org.jboss.resource are classes in the JCA component of the JBoss Application Server. The org.jboss.util classes are utility classes of the JBoss Application Server. The rest of the classes are standard JDK classes. I do not see even one JBoss Messaging class involved in this entire stack, so I don't really understand why you think this is a JBoss Messaging issue, or what we could do about it anyway since not one of the classes involved is from the JBoss Messaging project. As I posted on the forums, more than likely the JCA adapter is doing something silly in starting/stopping/enlisting transactions and JBoss Transactions is (correctly) barfing.

...

-- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

Kevin Conner (JIRA)

11:55 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Kevin Conner commented on JBMESSAGING-1706: ------------------------------------------- Just to clarify, Howard was involved in the customer case which is referenced from JBPAPP-1642.

...

Tim Fox (JIRA)

11:55 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Tim Fox commented on JBMESSAGING-1706: -------------------------------------- This JIRA should be filed against the JCA project , not the JBoss Messaging project.

...

Tim Fox (JIRA)

12:14 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Tim Fox commented on JBMESSAGING-1706: -------------------------------------- Looking at this more closely.

...

From my XA understanding the tx mgr might through a HeuristicMixedException if the resource manager fails when commit is called on it.

Since it rightly might expect commit to succeed after prepare has succeeded. When this happens - is there anything in the JBoss Messaging logs to indicate why commit failed?

...

Richard Kennard (JIRA)

12:44 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- I'll recreate it and see. However, you're probably right in that there is a normal messaging rollback (ie. a deadlock occurs, or a cluster node goes down etc), and I have no problem with HeuristicMixedException being thrown for that particular message. The problem is more that, once it is thrown, the node does not recover. Every message on every queue from then on just throws HeuristicMixedException. If the node recovered with just the loss of the original message (which was failing for its own reasons anyway) that would be okay.

...

Tim Fox (JIRA)

1:45 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Tim Fox commented on JBMESSAGING-1706: -------------------------------------- To be able to investigate this further, we would really need to see logs from when this problem occurred, so we can see what is happening in the JBM server at the time (trace).

...

Howard Gao (JIRA)

Monday, 17 August Mon, 17 Aug

12:11 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Howard Gao updated JBMESSAGING-1706: ------------------------------------ Fix Version/s: 1.4.0.SP3.CP09 1.4.5.GA Assignee: Howard Gao (was: Tim Fox)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP09, 1.4.5.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

Tuesday, 18 August Tue, 18 Aug

12:21 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- Howard, I notice there is now a 'fix version' against this JIRA. Does that mean you have found the problem and are working on a fix, or at least a speculative fix? That is exciting news. Regards, Richard.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP09, 1.4.5.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Tim Fox (JIRA)

1:01 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP09, 1.4.5.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

4:35 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Richard, I updated the 'fix version' only to make it more manageable. It doesn't mean any progressing of the issue itself. We still need to work on it. Thanks Howard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP09, 1.4.5.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

1:56 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP09, 1.4.5.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Wednesday, 16 September Wed, 16 Sep

3:33 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.6.GA I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

Wednesday, 23 September Wed, 23 Sep

8:19 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard updated JBMESSAGING-1706: ----------------------------------------- Attachment: server.zip My apologies for the delay in getting back to you. I am having a hard time creating a repeatable test case of this problem. However, in the meantime I have at least captured a log. The log (attached) is: 1. With everything set to log level ALL. At least I hope it's 'everything' :) 2. From the state when the system is 'stuck' in the HeuristicMixedException described. The log does NOT show the first time the HeuristicMixedException occured on the cluster node (It is quite easy to trigger it the first time just by shutting down a node in the cluster, I do have a repeatable test case for this). Rather, the log shows a subsequent attempt to access a JMS queue and how it fails. All subsequent attempts on all queues on the node fail in the same way. I have to reboot the node to get out of this 'stuck' state 3. The problem starts around 2009-09-23 16:08:49,082 Please let me know if this offers any clues. Regards, Richard.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.6.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

8:29 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- Note that, interestingly, HeuristicMixedException does not actually appear in this log. It appears on the front end, but possibly the HeuristicMixedException is actually masking the real error (a bit like a RollbackException or something). The real error appears to be around line 5187... Caused by: java.lang.IllegalStateException: Cannot find object in dispatcher with id g771-nnv8hxzf-1-rnsh8wzf-6fm2ec-11o4c5 at org.jboss.jms.wireformat.ConnectionStopRequest.serverInvoke(ConnectionStopRequest.java:64) ...so at last we have some org.jboss.jms classes in the stack trace :)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.6.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Saturday, 10 October Sat, 10 Oct

4:30 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Howard Gao updated JBMESSAGING-1706: ------------------------------------ Fix Version/s: 1.4.7.GA (was: 1.4.6.GA)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Armin Haaf (JIRA)

Thursday, 7 January Thu, 7 Jan

11:08 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Armin Haaf commented on JBMESSAGING-1706: ----------------------------------------- we had a similar problem here caused by a bug in jgroups. -> https://jira.jboss.org/jira/browse/JGRP-1006 After a node gots shunned we get lots of HeuristicMixedExceptions. Also another strange exception occurs: {noformat} 010-01-06 08:19:31,309 ERROR [org.jboss.messaging.util.ExceptionUtil] [T:1601] ConnectionEndpoint[wi7-jf14s34g-1-rv7lj24g-4e1p2z-q3c j5a] createSessionDelegate [1j7-dk14s34g-1-rv7lj24g-4e1p2z-q3cj5a] java.lang.IllegalStateException: Cannot find binding for queue DLQ at java.lang.Throwable.<init>(Throwable.java:67) at org.jboss.jms.server.ServerPeer.getDefaultDLQInstance(ServerPeer.java:1239) at org.jboss.jms.server.endpoint.ServerSessionEndpoint.<init>(ServerSessionEndpoint.java:228) at org.jboss.jms.server.endpoint.ServerConnectionEndpoint.createSessionDelegate(ServerConnectionEndpoint.java:249) at org.jboss.jms.server.endpoint.advised.ConnectionAdvised.org$jboss$jms$server$endpoint$advised$ConnectionAdvised$createSess ionDelegate$aop(ConnectionAdvised.java:75) at org.jboss.jms.server.endpoint.advised.ConnectionAdvised$createSessionDelegate_6052335267724906805.invokeTarget(ConnectionA dvised$createSessionDelegate_6052335267724906805.java) at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111) at org.jboss.jms.server.container.ServerLogInterceptor.invoke(ServerLogInterceptor.java:105) at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102) at org.jboss.jms.server.endpoint.advised.ConnectionAdvised.createSessionDelegate(ConnectionAdvised.java) at org.jboss.jms.wireformat.ConnectionCreateSessionDelegateRequest.serverInvoke(ConnectionCreateSessionDelegateRequest.java:8 7) at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143) at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:891) at org.jboss.remoting.transport.socket.ServerThread.completeInvocation(ServerThread.java:744) at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:697) at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:551) at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:232) {noformat}

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

Friday, 8 January Fri, 8 Jan

1:44 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- Howard, Is any progress being made on this issue? I would guess it's because org.jboss.jms.wireformat.ConnectionStopRequest is keeping some kind of handle to a session bean, and that session bean has been killed as part of the failover but it's still trying to use the old handle? I get this sort of thing in my own (unrelated) code from time to time and I have to catch and reconnect my handle to the session bean. RIchard.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP10, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Thursday, 4 March Thu, 4 Mar

4:50 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Richard Kennard (JIRA)

Thursday, 6 May Thu, 6 May

4:48 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- Howard, Can I just ping why nothing is happening with this issue? I attached what I thought was a pretty good log of the problem, and an error that could be resolved: Caused by: java.lang.IllegalStateException: Cannot find object in dispatcher with id g771-nnv8hxzf-1-rnsh8wzf-6fm2ec-11o4c5 at org.jboss.jms.wireformat.ConnectionStopRequest.serverInvoke(ConnectionStopRequest.java:64) Can I do anything else? Richard.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

7:16 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/jira/browse/JBMESSAGING-1706?page=com.atlassian.ji... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Richard, Sorry I haven't got time to continue with this issue. I'll come back asap. Thanks Howard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/jira/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Monday, 19 July Mon, 19 Jul

10:44 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hello Richard, The log shows that the connection id cannot be found at the server side during a connection.stop() call from the client. This is possible when the server side had received a connection failure and cleaned up the resources from the server, at the moment the client may not have known of this and when it calls the stop() method, the exception was thrown back. In such a case the client should properly handle it, either ignore it or do a reconnect, based on the real need. However, this is not likely to block the server from working (if the client handles it properly).

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

Richard Kennard (JIRA)

11:01 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Richard Kennard commented on JBMESSAGING-1706: ---------------------------------------------- Howard, Thank you so much for looking at this issue. I'm sorry if I misled you when I said, in my original post, 'that node in the cluster is effectively dead'. By 'effectively dead' I did not mean the whole server has stopped working. It still responds to HTTP requests and the EJBs still run and everything like that. But all future attempts to send a message to a JMS queue fail with a HeuristicMixedException. So I would welcome a 'speculative fix' based around the client 'either ignore it or do a reconnect'. And I can certainly test it for you. Regards, Richard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Piyush Panda (JIRA)

11:23 a.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Piyush Panda commented on JBMESSAGING-1706: ------------------------------------------- Hi Howard, I am getting the same exception at the following line of code: Caused by: java.lang.IllegalStateException: Cannot find object in dispatcher with id ue-9wnsusbg-1-it6musbg-l1ex8x-d31o4c5 at org.jboss.jms.wireformat.SessionSendRequest.serverInvoke(SessionSendRequest.java:101) So what do could be the reason in this case and what recommend me to do? I am using JBOSS 5.1.0.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

12:08 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Richard, According to you, the messages were probably being sent over an already dead connection within a tx context. But I can't figure out the details what happened. The log doesn't contains those parts. Can you upload the log covering the sending of the message as well as the Heuristic it caused? As for the 'fix', I can't do it easily as it looks like from the JCA layer that handling this. You probably can ask JCA guys for some help. Howard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

12:14 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Piyush, This kind of exceptions are usually caused by the server side clean up of failed connections. For example, the network undergoes some temp failure and cause the remoting layer lease timeout, it then notifies the jbm server of the event and the server cleans the related connections up. But for the moment it is still possible the client haven't got the notification and continue operations with the 'bad' connection. To verify you have the same case, look up the logs for any information saying the connection failure information. To reduce the situation, you can adjust your remoting parameters (lease timeout) according to your network condition. For a JMS client if such exceptions occurred and your client need to continue to work, you can close the old connection and create a new one. Howard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Piyush Panda (JIRA)

1:29 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Piyush Panda updated JBMESSAGING-1706: -------------------------------------- Attachment: JBOSS_Server_Logs.txt Client_Logs.txt

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Piyush Panda (JIRA)

1:34 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Piyush Panda commented on JBMESSAGING-1706: ------------------------------------------- Hi Howard, Thanks for the quick response. In my case the JMS Service and the java client are on the same physical machine, so I am not able to understand why the network failure is occurring. I have attached the JBOSS server logs and the client logs. Please have a look at them. Any further inputs will be highly appreciable. Also would adding a retry logic on MessagingJMSException in this case be a correct decision? Thanks, Piyush

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

1:39 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Piyush, The server log simply shows that JBM server got notified of the connection failures. I don't know why this is happening. Can you upload your remoting config file here? Thanks Howard

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Piyush Panda (JIRA)

1:49 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

3:42 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.7.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Wednesday, 28 July Wed, 28 Jul

11:03 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao updated JBMESSAGING-1706: ------------------------------------ Fix Version/s: 1.4.8.GA (was: 1.4.7.GA)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.8.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Piyush Panda (JIRA)

Thursday, 19 August Thu, 19 Aug

3:21 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Piyush Panda commented on JBMESSAGING-1706: ------------------------------------------- Hi Howard, I am still facing the issue that after few hours of receiving messages my listeners stop receiving messages. If I start a new listener listening to the same queue it starts getting the message. I do not get any exceptions so am not able to find out the reason why this is happening. Listener here is a spring managed POJO which is a standalone java program listening to a queue on the JBoss server. The listener is also set as an exception listener so that if the JMS connection breaks the onException should get called. Finally if i restart my server and the listeners everything works properly I am using JBOSS 5.1.0 GA, Jboss-Messaging-Clinet 1.4.3 and Jboss-Remoting 2.5.1. Earlier you had reviewed my remoting xml and said that it looks fine. I looked at JBoss messaging 1.4.3 guide and found there were few config parameters missing like: <attribute name="numberOfRetries" isParam="true">10</attribute> <attribute name="clientMaxPoolSize" isParam="true">200</attribute> Would you suggest me to add these to my remoting xml and try out? Any other suggestions are also welcome.

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.8.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Howard Gao (JIRA)

Friday, 20 August Fri, 20 Aug

12:35 p.m.

New subject: [JBoss JIRA] Commented: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Howard Gao commented on JBMESSAGING-1706: ----------------------------------------- Hi Piyush, 1.4.3.GA is an old version of JBM. I would suggest you to upgrade it. However JBM is in maintenance mode so that means no new community release available. Newer versions are provided only for supported EAP servers. So you need to manually build JBM from the svn tag. Latest tag is 1.4.7.GA. As for the two params I couldn't see they are related to the issue. But "clientMaxPoolSize" should be specified. (larger pool means better performance).

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Howard Gao Fix For: 1.4.0.SP3.CP11, 1.4.8.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (JIRA)

Wednesday, 3 November Wed, 3 Nov

1:38 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://jira.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.pl... ] Yong Hao Gao updated JBMESSAGING-1706: -------------------------------------- Fix Version/s: 1.4.0.SP3.CP12 (was: 1.4.0.SP3.CP11)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://jira.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP12, 1.4.8.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (JIRA)

Friday, 29 April Fri, 29 Apr

3:01 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://issues.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.... ] Yong Hao Gao updated JBMESSAGING-1706: -------------------------------------- Fix Version/s: 1.4.0.SP3.CP13 (was: 1.4.0.SP3.CP12)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP13, 1.4.8.GA Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

4:19 p.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

[ https://issues.jboss.org/browse/JBMESSAGING-1706?page=com.atlassian.jira.... ] Yong Hao Gao updated JBMESSAGING-1706: -------------------------------------- Fix Version/s: 1.4.8.SP1 (was: 1.4.8.GA)

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP13, 1.4.8.SP1 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

Wednesday, 22 June Wed, 22 Jun

2:52 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP13, 1.4.8.SP2 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

6:33 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP14, 1.4.8.SP2 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

Wednesday, 20 July Wed, 20 Jul

4:54 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP2 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

Thursday, 21 July Thu, 21 Jul

7:57 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP3 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (JIRA)

Friday, 9 September Fri, 9 Sep

5:33 a.m.

New subject: [JBoss JIRA] Updated: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP4 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (Updated) (JIRA)

Wednesday, 26 October Wed, 26 Oct

5:44 a.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP5 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

Yong Hao Gao (Updated) (JIRA)

Thursday, 27 October Thu, 27 Oct

3:22 p.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP6 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (Updated) (JIRA)

Thursday, 5 January Thu, 5 Jan

4:25 a.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP7 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (JIRA)

Monday, 16 April Mon, 16 Apr

6:07 a.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP8 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (JIRA)

Monday, 23 July Mon, 23 Jul

6:58 a.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP9 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

Yong Hao Gao (JIRA)

Wednesday, 17 October Wed, 17 Oct

4:26 a.m.

New subject: [JBoss JIRA] (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException

...

JBoss Messaging sometimes causes a HeuristicMixedException ---------------------------------------------------------- Key: JBMESSAGING-1706 URL: https://issues.jboss.org/browse/JBMESSAGING-1706 Project: JBoss Messaging Issue Type: Bug Components: JMS Clustering Affects Versions: 1.4.4.GA Reporter: Richard Kennard Assignee: Yong Hao Gao Fix For: 1.4.0.SP3.CP15, 1.4.8.SP10 Attachments: Client_Logs.txt, JBOSS_Server_Logs.txt, remoting-bisocket-service.xml, server.zip I am raising this JIRA to ask the JBoss Messaging Team to take ownership of this issue. The issue is that JBM intermittently (ie. when processing large amounts of messages, when bringing up/shutting down nodes in a cluster) throws a HeuristicMixedException. Once it does, that node in the cluster is effectively dead. No more messages get processed. My app has multiple queues, but once one queue on the node fails (say, the e-mail queue) then all queues stop working (say, the reports queues): they all report HeuristicMixedException whenever a messages is sent to them. I am using a workaround by having a separate monitoring program that reboots the node whenever it gets stuck in this HeuristicMixedException state. The JBoss ESB team have also had to implement a workaround: https://jira.jboss.org/jira/browse/JBESB-2484 Others on the forum are seeing this too: http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4241134#... According to Kevin Conner of the ESB team, Howard worked with them on a workaround: https://jira.jboss.org/jira/browse/JBPAPP-1642, but the issue persists.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

4202

days inactive

5366

days old

jboss-jira@lists.jboss.org

Manage subscription

47 comments

8 participants

tags (0)

participants (8)

Armin Haaf (JIRA)
Howard Gao (JIRA)
Kevin Conner (JIRA)
Piyush Panda (JIRA)
Richard Kennard (JIRA)
Tim Fox (JIRA)
Yong Hao Gao (JIRA)
Yong Hao Gao (Updated) (JIRA)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

[JBoss JIRA] Created: (JBMESSAGING-1706) JBoss Messaging sometimes causes a HeuristicMixedException