[jboss-jira] [JBoss JIRA] Commented: (JGRP-1157) JGroups threads get stuck and stop communicating

[ https://jira.jboss.org/jira/browse/JGRP-1157?page=com.atlassian.jira.plug... ] vivek v commented on JGRP-1157: ------------------------------- We debugged this issue little more (by attaching the debugger to one of the instance, which is having problem). Here is what I found by stepping into some of the stuck threads, 1) There were two sender threads (Node A -> B and Node A -> C). Both these sender threads were waiting on queue.take() , basically there was nothing to be read from the sender_queue, i.e, no messages. 2) There were lots of other threads, which were waiting on queue.put(). After tracing through those threads I found the TCPConnection object for this queue was different than the sender threads. This TCPConnection was for A-> B, but a different object altogether 3) I also found that there were no sender thread for this new TCPConnection object (# 2). So, basically all the messages were getting written to the queue, but there was no Sender thread for it to read it. In theory there should only be one TCPConnection (and one sender thread) for each node-to-node connection. In this case, we got two TCPConnection objects for the same node-to-node connection. I'm not sure how it is possible. Looks like one TCPConnection was created, sender thread started, but later due to some socket connect problem it was removed from the TCPConnectionMap, but the sender thread remained from that connection. Now later a new TCPConnection was started and added to the TCPConnectionMap, but for some reason its sender thread never got started - is it possible since, they both have the same thread-name they might fail (though unlikely). I'm attaching the snapshots to prove that we got two TCPConnections for the same peer_addr. Not sure if this is a race-condition, but this definitely seems like a problem. Is there a work-around for this problem? Like not using sender or something? What are the implications of not using sender (use_send_queues="false")? -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira