<div dir="ltr"><div><div><div>I've seen StateTransferLargeObjectTest hang on my machine
with all OOB threads waiting in
FlowControl$Credit.decrementIfEnoughCredits, but I thought that was
because the JGroups internal thread pool wasn't enabled in the test
configuration. Now that I've seen it's enabled by default, I think it
could be a JGroups problem after all.<br><br></div>I'll enable TRACE logging for
org.jgroups and hopefully I'll reproduce it again. For the
record, the test suite is running with TCP, and the internal thread pool
has queueing enabled by default, so I don't think any REPLENISH message could be
lost.<br><br></div>Cheers<br></div>Dan<br><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Oct 11, 2013 at 4:12 PM, Radim Vansa <span dir="ltr"><<a href="mailto:rvansa@redhat.com" target="_blank">rvansa@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I remember seeing that mostly on UDP, but I've had an issue with this<br>
over TCP as well on the cross-site link with multiple site masters<br>
(synchronous 1pc xs replication).<br>
<span class="HOEnZb"><font color="#888888"><br>
Radim<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On 10/11/2013 02:51 PM, Ray Tsang wrote:<br>
> Udp or tcp?<br>
><br>
> On Oct 11, 2013, at 8:41, Radim Vansa <<a href="mailto:rvansa@redhat.com">rvansa@redhat.com</a>> wrote:<br>
><br>
>> Hi,<br>
>><br>
>> since Infinispan moved to JGroups 3.4, we're experiencing occassional<br>
>> deadlocks in some tests - most of threads that send anything over<br>
>> JGroups are waiting in JGroups' FlowControl.decrementCredits. The<br>
>> problem sometimes goes away after several seconds, but it produces some<br>
>> ugly spikes in our througput/response time charts. Originally this<br>
>> affected just some RadarGun tests but this is appearing in some<br>
>> client-server tests as well (we've recently investigated an issue where<br>
>> this appeared in a regular soak test).<br>
>> I was looking into that [1] for some time but haven't really figured out<br>
>> the cause. The workaround is to set up MFC and UFC credits high enough<br>
>> (I use 10M) and stuff works then. I was trying to reproduce that on pure<br>
>> JGroups, but unsuccessfully.<br>
>> I am not asking anyone to dig into that, but I wanted to know whether QA<br>
>> is alone experiencing that or if there are more of us.<br>
>><br>
>> Radim<br>
>><br>
>> [1] <a href="https://issues.jboss.org/browse/JGRP-1675" target="_blank">https://issues.jboss.org/browse/JGRP-1675</a><br>
>><br>
>> --<br>
>> Radim Vansa <<a href="mailto:rvansa@redhat.com">rvansa@redhat.com</a>><br>
>> JBoss DataGrid QA<br>
>><br>
>> _______________________________________________<br>
>> infinispan-dev mailing list<br>
>> <a href="mailto:infinispan-dev@lists.jboss.org">infinispan-dev@lists.jboss.org</a><br>
>> <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br>
> _______________________________________________<br>
> infinispan-dev mailing list<br>
> <a href="mailto:infinispan-dev@lists.jboss.org">infinispan-dev@lists.jboss.org</a><br>
> <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br>
<br>
<br>
--<br>
Radim Vansa <<a href="mailto:rvansa@redhat.com">rvansa@redhat.com</a>><br>
JBoss DataGrid QA<br>
<br>
_______________________________________________<br>
infinispan-dev mailing list<br>
<a href="mailto:infinispan-dev@lists.jboss.org">infinispan-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br>
</div></div></blockquote></div><br></div>