The executor services passed in to withCachedThreadPool should be wrapper for submitting Work instances to the WorkManager.
You could run your server socket in a Work instance too - I probably would...
See http://www.ironjacamar.org/doc/userguide/1.1/en-US/html/ch01.html#overview for your outbound/inbound architecture.
Otherwise let us know more details about your setup - but read the above first.