<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Thanks.<div><br><div><div>On 18 Sep 2012, at 19:02, Erik Salter wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>FYI: <a href="https://issues.jboss.org/browse/ISPN-2319">https://issues.jboss.org/browse/ISPN-2319</a><br><br>-----Original Message-----<br>From: <a href="mailto:infinispan-dev-bounces@lists.jboss.org">infinispan-dev-bounces@lists.jboss.org</a><br>[mailto:infinispan-dev-bounces@lists.jboss.org] On Behalf Of Bela Ban<br>Sent: Monday, September 17, 2012 2:42 AM<br>To: <a href="mailto:infinispan-dev@lists.jboss.org">infinispan-dev@lists.jboss.org</a><br>Subject: Re: [infinispan-dev] X-Site: Site Unreachable vs. Site Down<br><br>I agree that there should be a configuration which determines after how many<br>SITE-UNREACHABLE events (combined with a timeout), a site is declared as<br>offline. (The count should be reset when there is a successful RPC to the<br>remote site).<br><br>Once a site is taken offline, then no RPCs would be sent to it, until it is<br>taken online again (manually, by a sysadmin), and the state transfer has<br>completed.<br><br>Example: lon={A,B,C}, sfo={X,Y,Z}.<br>- We're in London (lon), sfo acts as the backup site to lon<br>- An RPC in lon includes A,B and SiteMaster(sfo) as targets<br>- Before the RPC hits X, X crashes<br>- JGroups retries X (a few times, timeout < "timeout" configured in <backup<br>site=.../>)<br>- Y takes over<br>- JGroups re-routes the RPC to Y<br>- The caller completes the RPC successfully<br><br>- Now connectivity to sfo goes down<br>- A caller in lon invokes an RPC on A,C and SiteMaster(sfo)<br>- The call fails after 16s<br>- Another RPC fails after 16s<br>- After N failed RPCs, Infinispan in lon marks sfo as down (offline)<br>- The next RPC has B and C as targets, but not SiteMaster(sfo) anymore,<br>until sfo is brought online (manually)<br><br><br>On 9/17/12 3:21 AM, Erik Salter wrote:<br><blockquote type="cite">Hi all,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">For the X-Site pull request, Bela, Mircea and I had a design review. One<br></blockquote>of<br><blockquote type="cite">the items that came up was the ability to mark a site as being "down" -<br></blockquote><blockquote type="cite">where a site has been unreachable for a period of time. This mostly<br></blockquote>applies<br><blockquote type="cite">to the synchronous replication case where the backup failure policy has<br></blockquote>been<br><blockquote type="cite">configured as "FAIL", i.e:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><namedCache name="importantCache"><br></blockquote><blockquote type="cite"> <sites><br></blockquote><blockquote type="cite"> <backups><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><backup site="NYC" strategy="SYNC" backupFailurePolicy="FAIL"<br></blockquote>timeout="16000<br><blockquote type="cite">0"/><br></blockquote><blockquote type="cite"> </backups><br></blockquote><blockquote type="cite"></sites><br></blockquote><blockquote type="cite"></namedCache><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The current implementation would be to fail all requests until a SA<br></blockquote>realizes<br><blockquote type="cite">the site is offline and mark it through a JMX operation (provided in this<br></blockquote><blockquote type="cite">release?). Since I cannot afford a 100% failure rate until somebody gets<br></blockquote><blockquote type="cite">called, I think we need to take it a step further and add an element to<br></blockquote>mark<br><blockquote type="cite">a site as offline after a period of time. (Note, though, a site can only<br></blockquote><blockquote type="cite">be brought back online manually.)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Mircea talked about adding an element in the configuration for a custom<br></blockquote><blockquote type="cite">callback implementation. However, I think this is useful enough -- not<br></blockquote>only<br><blockquote type="cite">for me -- but for other ISPN/JDG users as well. (Not to mention we can't<br></blockquote><blockquote type="cite">add configuration for callbacks)<br></blockquote><br><br>-- <br>Bela Ban, JGroups lead (<a href="http://www.jgroups.org">http://www.jgroups.org</a>)<br>_______________________________________________<br>infinispan-dev mailing list<br><a href="mailto:infinispan-dev@lists.jboss.org">infinispan-dev@lists.jboss.org</a><br>https://lists.jboss.org/mailman/listinfo/infinispan-dev<br><br>_______________________________________________<br>infinispan-dev mailing list<br>infinispan-dev@lists.jboss.org<br>https://lists.jboss.org/mailman/listinfo/infinispan-dev<br></div></blockquote></div><br><div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Cheers,</div><div>-- <br>Mircea Markus</div><div>Infinispan lead (<a href="http://www.infinispan.org">www.infinispan.org</a>)</div><div><br></div></div></span></div></span></div></span></div></span><br class="Apple-interchange-newline"></span><br class="Apple-interchange-newline">
</div>
<br></div></body></html>