<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<body link="#355491" alink="#4262a1" vlink="#355491" style="background: #e2e2e2; margin: 0; padding: 20px;">
<div>
<table cellpadding="0" bgcolor="#FFFFFF" border="0" cellspacing="0" style="border: 1px solid #dadada; margin-bottom: 30px; width: 100%; -moz-border-radius: 6px; -webkit-border-radius: 6px;">
<tbody>
<tr>
<td>
<table border="0" cellpadding="0" cellspacing="0" bgcolor="#FFFFFF" style="border: solid 2px #ccc; background: #dadada; width: 100%; -moz-border-radius: 6px; -webkit-border-radius: 6px;">
<tbody>
<tr>
<td bgcolor="#000000" valign="middle" height="58px" style="border-bottom: 1px solid #ccc; padding: 20px; -moz-border-radius-topleft: 3px; -moz-border-radius-topright: 3px; -webkit-border-top-right-radius: 5px; -webkit-border-top-left-radius: 5px;">
<h1 style="color: #333333; font: bold 22px Arial, Helvetica, sans-serif; margin: 0; display: block !important;">
<!-- To have a header image/logo replace the name below with your img tag -->
<!-- Email clients will render the images when the message is read so any image -->
<!-- must be made available on a public server, so that all recipients can load the image. -->
<a href="http://community.jboss.org/index.jspa" style="text-decoration: none; color: #E1E1E1">JBoss Community</a></h1>
</td>
</tr>
<tr>
<td bgcolor="#FFFFFF" style="font: normal 12px Arial, Helvetica, sans-serif; color:#333333; padding: 20px; -moz-border-radius-bottomleft: 4px; -moz-border-radius-bottomright: 4px; -webkit-border-bottom-right-radius: 5px; -webkit-border-bottom-left-radius: 5px;"><h3 style="margin: 10px 0 5px; font-size: 17px; font-weight: normal;">
Distributed queue and several cluster partitions
</h3>
<span style="margin-bottom: 10px;">
created by <a href="http://community.jboss.org/people/ecimon">Szymon Biliński</a> in <i>JBoss Messaging</i> - <a href="http://community.jboss.org/message/628525#628525">View the full discussion</a>
</span>
<hr style="margin: 20px 0; border: none; background-color: #dadada; height: 1px;">
<div class="jive-rendered-content"><p>Hi,</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>I'm running four JBoss AS 5.1 instances on a single, non-multihomed server (for testing purposes only) and I'm having some difficulties with my JBoss Messaging setup. </p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>My cluster layout is as follows:</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><table border="1" cellpadding="3" cellspacing="0" class="jiveBorder" height="131" style="border-top-width: 1px; border-right-width: 1px; border-bottom-width: 1px; border-left-width: 1px; border-top-style: solid; border-right-style: solid; border-bottom-style: solid; border-left-style: solid; border-top-color: rgb(0, 0, 0); border-right-color: rgb(0, 0, 0); border-bottom-color: rgb(0, 0, 0); border-left-color: rgb(0, 0, 0); height: 105px; width: 873px;"><tbody><tr><th align="center" style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;background-color: #6690bc;" valign="middle"><span style="color: #ffffff;"><strong>Host<br/></strong></span></th><th align="center" style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;background-color: #6690bc;" valign="middle"><span style="color: #ffffff;"><strong>Partiton</strong></span></th><th align="center" style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;background-color: #6690bc;" valign="middle">Ports<br/></th><th align="center" style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;background-color: #6690bc;" valign="middle"><strong>ServerPeerID</strong></th></tr><tr><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">service0</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ServicePartition</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ports-default</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">1</td></tr><tr><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">service1</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ServicePartition</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ports-01</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">2</td></tr><tr><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">web0</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">WebPartition</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ports-02</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">3</td></tr><tr><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">web1</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">WebPartition</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">ports-03</td><td style="border:1px solid black;border-left-color: rgb(0, 0, 0);border-bottom-color: rgb(0, 0, 0);border-right-color: rgb(0, 0, 0);border-top-color: rgb(0, 0, 0);border-left-style: solid;border-bottom-style: solid;border-right-style: solid;border-top-style: solid;border-left-width: 1px;border-bottom-width: 1px;border-right-width: 1px;border-top-width: 1px;">4</td></tr></tbody></table><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>I'm also using a shared PostgreSQL instance as a persistence provider inside the ServicePartion (no messaging related changes were applied to the WebPartion nodes). I used the attached example  (docs/)  to create my server/all/deploy/messaging/postgresql-persistence-service.xml on all service nodes. I also applied two minor changes to the PostOffice mbean definition: Clustered and FailoverOnNodeLeave attributes were set to true.</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>My JMS queue is deployed as a part of the service.ear archive (which goes to service nodes only):</p><pre class="jive-pre"><code class="jive-code jive-xml">
<span class="jive-xml-tag"><server></span>
   <span class="jive-xml-tag"><mbean code="org.jboss.jms.server.destination.QueueService"
      name="jboss.messaging.destination:service=Queue,name=DictionaryTestQueue"
      xmbean-dd="xmdesc/Queue-xmbean.xml"></span>
      <span class="jive-xml-tag"><depends optional-attribute-name="ServerPeer"></span>jboss.messaging:service=ServerPeer<span class="jive-xml-tag"></depends></span>
      <span class="jive-xml-tag"><depends></span>jboss.messaging:service=PostOffice<span class="jive-xml-tag"></depends></span>
      <span class="jive-xml-tag"><attribute name="Clustered"></span>true<span class="jive-xml-tag"></attribute></span>
   <span class="jive-xml-tag"></mbean></span>
<span class="jive-xml-tag"></server></span>
</code></pre><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p class="p1" style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>As long as both Web nodes are down everything works fine - I'm able to connect to queue/DictionaryTestQueue with a standalone client (using HA-JNDI) and send a simple text message, which is consequently load balanced across both service nodes. </p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>However, as soon as I launch a Web node, I ocasionally get the following exception (same, standalone client):</p><pre class="jive-pre"><code class="jive-code">
Caused by: javax.jms.JMSException: Failed to route Reference[57607127264149508]:RELIABLE to DictionaryTestQueue
          at org.jboss.jms.server.endpoint.ServerConnectionEndpoint.sendMessage(ServerConnectionEndpoint.java:757)
          at org.jboss.jms.server.endpoint.ServerSessionEndpoint.send(ServerSessionEndpoint.java:399)
          at org.jboss.jms.server.endpoint.advised.SessionAdvised.org$jboss$jms$server$endpoint$advised$SessionAdvised$send$aop(SessionAdvised.java:87)
          at org.jboss.jms.server.endpoint.advised.SessionAdvised$send_7280680627620114891.invokeTarget(SessionAdvised$send_7280680627620114891.java)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
          at org.jboss.jms.server.container.SecurityAspect.handleSend(SecurityAspect.java:157)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.aop.advice.PerInstanceAdvice.invoke(PerInstanceAdvice.java:122)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.server.endpoint.advised.SessionAdvised.send(SessionAdvised.java)
          at org.jboss.jms.wireformat.SessionSendRequest.serverInvoke(SessionSendRequest.java:95)
          at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:143)
          at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:891)
          at org.jboss.remoting.transport.socket.ServerThread.completeInvocation(ServerThread.java:744)
          at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:697)
          at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:551)
          at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:232)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:211)
          at org.jboss.remoting.Client.invoke(Client.java:1724)
          at org.jboss.remoting.Client.invoke(Client.java:629)
          at org.jboss.remoting.Client.invoke(Client.java:617)
          at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:189)
          at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:160)
          at org.jboss.jms.client.delegate.ClientSessionDelegate.org$jboss$jms$client$delegate$ClientSessionDelegate$send$aop(ClientSessionDelegate.java:499)
          at org.jboss.jms.client.delegate.ClientSessionDelegate$send_6145266547759487588.invokeTarget(ClientSessionDelegate$send_6145266547759487588.java)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)
          at org.jboss.jms.client.container.SessionAspect.handleSend(SessionAspect.java:661)
          at org.jboss.aop.advice.org.jboss.jms.client.container.SessionAspect_z_handleSend_194171714.invoke(SessionAspect_z_handleSend_194171714.java)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:114)
          at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
          at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.client.delegate.ClientSessionDelegate.send(ClientSessionDelegate.java)
          at org.jboss.jms.client.container.ProducerAspect.handleSend(ProducerAspect.java:269)
          at org.jboss.aop.advice.org.jboss.jms.client.container.ProducerAspect_z_handleSend_194171714.invoke(ProducerAspect_z_handleSend_194171714.java)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)
          at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)
          at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)
          at org.jboss.jms.client.delegate.ClientProducerDelegate.send(ClientProducerDelegate.java)
          at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:164)
          at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:207)
          at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:145)
          at org.jboss.jms.client.JBossMessageProducer.send(JBossMessageProducer.java:136)
</code></pre><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>So it looks to me like a service partiion node is trying to use a web node for queue lookup. Is this the correct behaviour or am I missing something here? </p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>What would be the recommended approach here? Should I define my application queues/setup messaging on all cluster nodes (both partions) or should I keep it separate? </p></div>
<div style="background-color: #f4f4f4; padding: 10px; margin-top: 20px;">
<p style="margin: 0;">Reply to this message by <a href="http://community.jboss.org/message/628525#628525">going to Community</a></p>
<p style="margin: 0;">Start a new discussion in JBoss Messaging at <a href="http://community.jboss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2042">Community</a></p>
</div></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</body>
</html>