I've found a solution to this.
What I did was uncomment
<attribute name="secondaryBindPort">4460</attribute>
in remoting-bisocket-service.xml
and give it an available port.
And the connection was successful.
I am the happiest man on my chair right now.