<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On 18 Mar 2011, at 07:12, Bela Ban wrote:</div><blockquote type="cite"><div><font class="Apple-style-span" color="#000000"><br></font><blockquote type="cite">Initially we were seeing lots of little clusters form, increasing the number of initial members in the PING section of the jgroups-udp.xml file and increasing the<br></blockquote><blockquote type="cite">timeouts seems to have made things better but not great. Even at 20 <br></blockquote>nodes, we are seeing messages where the coordinator is failing to flush.<br><br>I do *not* recommend FLUSH in clusters bigger than 10-15 nodes ! FLUSH <br>will definitely kill you if you have clusters of 100s of nodes.<br><br>IIRC, Infinispan requires FLUSH, but I think this was removed in <br>4.2.1.FINAL. Maybe Manik or Vladimir can comment ?<br></div></blockquote><div><br></div><div>4.2.1.FINAL isn't out yet, but it should be soon.</div><div><br></div><div>The strategy I'm taking is that FLUSH will still be enabled and required to maintain the same behaviour as 4.2.0, but you will be able to switch this check off with a system property flag, and provide a JGroups config that excludes FLUSH.</div><br><blockquote type="cite"><div><blockquote type="cite">It does not appear that the default configuration scales to a large size.<br></blockquote><br><br>Correct. The default config is geared toward a 4-16 node cluster.<br></div></blockquote><div><br></div><div>Yes, you will need to tune your JGroups config for larger clusters. Maybe it makes sense to ship a "jgroups-large-cluster.xml" config as well, to help ease the complexity of this in future.</div></div><div><br></div><div>Cheers</div><div>Manik</div><br><div>
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div><div>--</div><div>Manik Surtani</div><div><a href="mailto:manik@jboss.org">manik@jboss.org</a></div><div><a href="http://twitter.com/maniksurtani">twitter.com/maniksurtani</a></div><div><br></div><div>Lead, Infinispan</div><div><a href="http://www.infinispan.org">http://www.infinispan.org</a></div><div><br></div></div></span><br class="Apple-interchange-newline">
</div>
<br></body></html>