Connection.Receiver - Failed handling incoming message ------------------------------------------------------ Key: JGRP-2256 URL: https://issues.redhat.com/browse/JGRP-2256 Project: JGroups Issue Type: Bug Affects Versions: 4.0.10 Reporter: Sibin Karnavar Assignee: Bela Ban Priority: Minor In AWS environment, I have not defined the port {color:red}41493{color} . I have configured TCP bind_port as 7803. But I can see from the below stack-trace that, Connection.Receiver [10.91.133.210:7803 - 10.91.135.64:{color:red}41493{color}] 1) Do I need to open/configure any other port ? I am wondering How 41493 is used when i have configured my bind_port as 7803. 2) What is the significance of client_bind_port for TCP. What happens if I dont configure it? 2018-03-05 19:07:28.833 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:29.834 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 1 2018-03-05 19:07:32.842 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:32.889 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 2 2018-03-05 19:07:35.944 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 3 2018-03-05 19:07:36.848 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:38.999 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 4 2018-03-05 19:07:40.854 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:42.053 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 5 2018-03-05 19:07:44.860 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:45.108 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 6 2018-03-05 19:07:48.163 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 7 2018-03-05 19:07:48.866 ERROR 23012 --- [TQ-Bundler-9,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000034: ip-10-91-133-210-46045: failure sending message to ip-10-91-135-64-18021: java.net.SocketTimeoutException: connect timed out 2018-03-05 19:07:51.218 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: JOIN(ip-10-91-133-210-46045) sent to ip-10-91-135-64-18021 timed out (after 3000 ms), on try 8 2018-03-05 19:07:51.218 WARN 23012 --- [localhost-startStop-1] org.jgroups.protocols.pbcast.GMS : - - ip-10-91-133-210-46045: too many JOIN attempts (8): becoming singleton 2018-03-05 19:07:52.041 ERROR 23012 --- [Connection.Receiver [10.91.133.210:7803 - 10.91.135.64:41493]-12,ABC-SKS-stage_SJX_040320181613_XSJ,ip-10-91-133-210-46045] org.jgroups.protocols.TCP : - - JGRP000030: ip-10-91-133-210-46045: failed handling incoming message java.io.IOException: Stream closed at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:170) at java.io.BufferedInputStream.read(BufferedInputStream.java:269) at java.io.DataInputStream.readByte(DataInputStream.java:265) at org.jgroups.Message.readFrom(Message.java:724) at org.jgroups.util.Util.readMessageBatch(Util.java:1193) at org.jgroups.protocols.TP.handleMessageBatch(TP.java:1329) at org.jgroups.protocols.TP.receive(TP.java:1321) at org.jgroups.blocks.cs.BaseServer.receive(BaseServer.java:171) at org.jgroups.blocks.cs.TcpConnection$Receiver.run(TcpConnection.java:290) at java.lang.Thread.run(Thread.java:745)