<html>
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 10 (filtered)">
<style>
<!--
/* Font Definitions */
@font-face
        {font-family:Helvetica;
        panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
        {font-family:SimSun;
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
        {font-family:"\@SimSun";
        panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:blue;
        text-decoration:underline;}
p
        {margin-right:0in;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman";}
p.NormalWeb1, li.NormalWeb1, div.NormalWeb1
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.EmailStyle21
        {font-family:Arial;
        color:navy;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
        {page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=blue>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> Won’t be able to get CR4
uploaded, policy dictates that I wait until final release. However, I was able
to get 431 nodes up and running as a replicated cluster and 115 nodes up as a
distributed cluster. For the 430 node cache, I was able to get it started with
no problems about 50% of the time. When they formed multiple clusters they
merged together only some of the time. It really does appear to be a startup
issue at thi</span></font><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>s p</span></font><font
size=2 color=navy face=Arial><span style='font-size:10.0pt;font-family:Arial;
color:navy'>oint. We have not pushed it hard enough yet to see what happens at
this scale under load. </span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Any idea when CR4 will be FINAL?</span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Are there any tools to help diagnose
problems / performance at this scale (I ended up writing my own monitor
program)?</span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Dave</span></font><font size=2
color=navy face=Arial><span style='font-size:10.0pt;font-family:Arial;
color:navy'> Marion</span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>-----Original Message-----<br>
<b><span style='font-weight:bold'>From:</span></b>
infinispan-dev-bounces@lists.jboss.org
[mailto:infinispan-dev-bounces@lists.jboss.org] <b><span style='font-weight:
bold'>On Behalf Of </span></b>david marion<br>
<b><span style='font-weight:bold'>Sent:</span></b> Friday, March 18, 2011 12:26
PM<br>
<b><span style='font-weight:bold'>To:</span></b> infinispan-dev@lists.jboss.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [infinispan-dev]
Infinispan Large Scale support</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> <br>
I will see if I can get 4.2.1.CR4 uploaded onto the
system. Is there a reference to the system property in question?<br>
</span></font></p>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=2 face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>
<hr size=2 width="100%" align=center>
</span></font></div>
<p class=MsoNormal style='margin-right:0in;margin-bottom:12.0pt;margin-left:
.5in'><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>From:
manik@jboss.org<br>
Date: Fri, 18 Mar 2011 16:07:06 +0000<br>
To: infinispan-dev@lists.jboss.org<br>
Subject: Re: [infinispan-dev] Infinispan Large Scale support<br>
<br>
</span></font></p>
<div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>On 18 Mar 2011, at 15:45, david
marion wrote:</span></font></p>
</div>
<blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> </span></font></p>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'><span style='word-spacing:0px'>Bela,<br>
<br>
Agreed, increasing the timeouts is probably not the way to
go. However I am at the mercy of whatever Infinispan is doing. As
for the notion of Infinispan being tested at 1000 nodes:<br>
<br>
Manik was quoted here:<span class=ecxapple-converted-space> </span><a
href="http://itmanagement.earthweb.com/netsys/article.php/3864436/Red-Hat-Ramps-Up-Open-Source-Cloud-Projects.htm"
target="_blank">http://itmanagement.earthweb.com/netsys/article.php/3864436/Red-Hat-Ramps-Up-Open-Source-Cloud-Projects.htm</a></span></font></p>
</div>
</blockquote>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'></span> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>Yeah, we got a hold of an 1100 node
cluster to test on at that time. But that cluster proved unstable and
kept falling over with network issues.</span></font></p>
</div>
<blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> </span></font></p>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'><span style='word-spacing:0px'>
It was never denied here:<span class=ecxapple-converted-space> </span><a
href="http://community.jboss.org/thread/156494?tstart=0" target="_blank">http://community.jboss.org/thread/156494?tstart=0</a><br>
and I'll have to wait until I get home to dig up an email that I think I
have.<br>
<br>
However, I'm not assigning blame, I was under the impression that it had been
tested at 1000 nodes. I just had it up at 430 nodes, but I can't reliably get
it to that size when I restart it. I think the answer is that Infinispan will
have to use what will scale in JGroups (remove what does not scale). Until then
I will have to scale it down to a size that I can start in a reliable fashion.<span
class=ecxapple-converted-space> </span><br>
<br>
Still no answer on whether ISPN-83 will be in 4.2.1.....</span></font></p>
</div>
</blockquote>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'></span> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>See my response earlier on this
thread about this.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>Specifically, Infinispan throws a
config exception if FLUSH is *not* present. However, we did cut a release
without this check and ran our defaults without FLUSH. It worked well
enough for most people, except one important use case. And this is what needs
further investigation. It seems as though the problem with that use case
was not the removal of FLUSH, but some dependence in the test in question on
FLUSH. But it's too late in the 4.2.1 cycle to pull something like
this, hence my proposal to leave FLUSH in by default but to allow a
FLUSH-free config via a (temporary, 4.2.x only) system property while we
investigate properly removing FLUSH in 5.0.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>Cheers</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>Manik</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>--</span></font></p>
</div>
</div>
<div><span style='word-spacing:0px'>
<div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'>Manik
Surtani</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'><a
href="mailto:manik@jboss.org">manik@jboss.org</a></span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'><a
href="http://twitter.com/maniksurtani" target="_blank">twitter.com/maniksurtani</a></span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'>Lead,
Infinispan</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'><a
href="http://www.infinispan.org/" target="_blank">http://www.infinispan.org</a></span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=4 color=black
face=Helvetica><span style='font-size:13.5pt;font-family:Helvetica;color:black'> </span></font></p>
</div>
</div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'></span> </span></font></p>
</div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'><br>
<br>
_______________________________________________ infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev </span></font></p>
</div>
</body>
</html>