[jboss-jira] [JBoss JIRA] (WFLY-10290) jboss.iiop-openjdk.poa-service.namingpoa service reload issues after server migration

Petr Kremensky (JIRA) issues at jboss.org
Tue Apr 24 06:26:00 EDT 2018


     [ https://issues.jboss.org/browse/WFLY-10290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Petr Kremensky updated WFLY-10290:
----------------------------------
    Description: 
*jboss.iiop-openjdk.poa-service.namingpoa* service throws java.net.BindException: Address already in use upon server reload after manual migration from older EAP release.

https://access.qa.redhat.com/documentation/en-us/red_hat_jboss_enterprise_application_platform/7.1/html-single/migration_guide/#management_cli_migration_operation

The issue can be reproduced with EAP 7.1.0 as TARGET_HOME as well.
   
*steps to reproduce* with the current (720397b26d) wildfly master:
{noformat}
WORKSPACE=`pwd`
CONFIG=standalone-full-ha.xml

unzip -q jboss-eap-6.4.19.zip
cp -r wildfly/dist/target/wildfly-13.0.0.Alpha1-SNAPSHOT wildfly

SOURCE_HOME=${WORKSPACE}/jboss-eap-6.4
TARGET_HOME=${WORKSPACE}/wildfly

cp ${SOURCE_HOME}/standalone/configuration/${CONFIG} ${TARGET_HOME}/standalone/configuration
${TARGET_HOME}/bin/standalone.sh -c ${CONFIG} --start-mode=admin-only &
${TARGET_HOME}/bin/jboss-cli.sh --connect --controller=remote://localhost:9999
# Migrate
/subsystem=jacorb:migrate
/subsystem=messaging:migrate
/subsystem=web:migrate
/subsystem=cmp:remove
/extension=org.jboss.as.cmp:remove
/subsystem=jaxr:remove
/extension=org.jboss.as.jaxr:remove
/subsystem=threads:remove
/extension=org.jboss.as.threads:remove
# Enable console logging
/subsystem=logging/pattern-formatter=COLOR-PATTERN:add(pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%e%n")
/subsystem=logging/console-handler=CONSOLE:add(level=INFO, named-formatter=COLOR-PATTERN)
/subsystem=logging/root-logger=ROOT:add-handler(name=CONSOLE)

# reload the server twice to get the exception
reload
reload
{noformat}

   
*server log errors*
{noformat}
12:01:52,041 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "iiop-openjdk")]) - failure description: {
    "WFLYCTL0080: Failed services" => {"jboss.iiop-openjdk.poa-service.rootpoa" => "WFLYIIOP0098: Failed to resolve initial reference RootPOA
    Caused by: org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
    Caused by: java.net.BindException: Address already in use"},
    "WFLYCTL0288: One or more services were unable to start due to one or more indirect dependencies not being available." => {
        "Services that were unable to start:" => [
            "jboss.iiop-openjdk.poa-service.irpoa",
            "jboss.iiop-openjdk.poa-service.namingpoa"
        ],
        "Services that may be the cause:" => ["jboss.iiop-openjdk.poa-service.namingpoa"]
    }
}
{noformat}
   
*Exception stack trace*
{noformat}
12:01:51,881 SEVERE [javax.enterprise.resource.corba._DEFAULT_.rpc.transport] (MSC service thread 1-6) "IOP00410216: (COMM_FAILURE) Unable to create listener thread on the specified port: 3529": org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2632)
	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2651)
	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:164)
	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.getAcceptors(CorbaTransportManagerImpl.java:218)
	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.addToIORTemplate(CorbaTransportManagerImpl.java:236)
	at com.sun.corba.se.spi.oa.ObjectAdapterBase.initializeTemplate(ObjectAdapterBase.java:122)
	at com.sun.corba.se.impl.oa.poa.POAImpl.initialize(POAImpl.java:404)
	at com.sun.corba.se.impl.oa.poa.POAImpl.makeRootPOA(POAImpl.java:272)
	at com.sun.corba.se.impl.oa.poa.POAFactory$1.evaluate(POAFactory.java:205)
	at com.sun.corba.se.impl.orbutil.closure.Future.evaluate(Future.java:46)
	at com.sun.corba.se.impl.resolver.LocalResolverImpl.resolve(LocalResolverImpl.java:40)
	at com.sun.corba.se.impl.resolver.CompositeResolverImpl.resolve(CompositeResolverImpl.java:45)
	at com.sun.corba.se.impl.orb.ORBImpl.resolve_initial_references(ORBImpl.java:1169)
	at org.wildfly.iiop.openjdk.service.CorbaPOAService.start(CorbaPOAService.java:156)
	at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1714)
	at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1693)
	at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1540)
	at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
	at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1364)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.BindException: Address already in use
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.wildfly.iiop.openjdk.security.SocketFactoryBase.createServerSocket(SocketFactoryBase.java:59)
	at org.wildfly.iiop.openjdk.security.NoSSLSocketFactory.createServerSocket(NoSSLSocketFactory.java:50)
	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:161)
	... 19 more
{noformat}


  was:
*jboss.iiop-openjdk.poa-service.namingpoa* service throws java.net.BindException: Address already in use upon server reload after manual migration from older EAP release.

The issue can be reproduced with EAP 7.1.0 as TARGET_HOME as well.
   
*steps to reproduce* with the current (720397b26d) wildfly master:
{noformat}
WORKSPACE=`pwd`
CONFIG=standalone-full-ha.xml

unzip -q jboss-eap-6.4.19.zip
cp -r wildfly/dist/target/wildfly-13.0.0.Alpha1-SNAPSHOT wildfly

SOURCE_HOME=${WORKSPACE}/jboss-eap-6.4
TARGET_HOME=${WORKSPACE}/wildfly

cp ${SOURCE_HOME}/standalone/configuration/${CONFIG} ${TARGET_HOME}/standalone/configuration
${TARGET_HOME}/bin/standalone.sh -c ${CONFIG} --start-mode=admin-only &
${TARGET_HOME}/bin/jboss-cli.sh --connect --controller=remote://localhost:9999
# Migrate
/subsystem=jacorb:migrate
/subsystem=messaging:migrate
/subsystem=web:migrate
/subsystem=cmp:remove
/extension=org.jboss.as.cmp:remove
/subsystem=jaxr:remove
/extension=org.jboss.as.jaxr:remove
/subsystem=threads:remove
/extension=org.jboss.as.threads:remove
# Enable console logging
/subsystem=logging/pattern-formatter=COLOR-PATTERN:add(pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%e%n")
/subsystem=logging/console-handler=CONSOLE:add(level=INFO, named-formatter=COLOR-PATTERN)
/subsystem=logging/root-logger=ROOT:add-handler(name=CONSOLE)

# reload the server twice to get the exception
reload
reload
{noformat}

   
*server log errors*
{noformat}
12:01:52,041 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "iiop-openjdk")]) - failure description: {
    "WFLYCTL0080: Failed services" => {"jboss.iiop-openjdk.poa-service.rootpoa" => "WFLYIIOP0098: Failed to resolve initial reference RootPOA
    Caused by: org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
    Caused by: java.net.BindException: Address already in use"},
    "WFLYCTL0288: One or more services were unable to start due to one or more indirect dependencies not being available." => {
        "Services that were unable to start:" => [
            "jboss.iiop-openjdk.poa-service.irpoa",
            "jboss.iiop-openjdk.poa-service.namingpoa"
        ],
        "Services that may be the cause:" => ["jboss.iiop-openjdk.poa-service.namingpoa"]
    }
}
{noformat}
   
*Exception stack trace*
{noformat}
12:01:51,881 SEVERE [javax.enterprise.resource.corba._DEFAULT_.rpc.transport] (MSC service thread 1-6) "IOP00410216: (COMM_FAILURE) Unable to create listener thread on the specified port: 3529": org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2632)
	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2651)
	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:164)
	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.getAcceptors(CorbaTransportManagerImpl.java:218)
	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.addToIORTemplate(CorbaTransportManagerImpl.java:236)
	at com.sun.corba.se.spi.oa.ObjectAdapterBase.initializeTemplate(ObjectAdapterBase.java:122)
	at com.sun.corba.se.impl.oa.poa.POAImpl.initialize(POAImpl.java:404)
	at com.sun.corba.se.impl.oa.poa.POAImpl.makeRootPOA(POAImpl.java:272)
	at com.sun.corba.se.impl.oa.poa.POAFactory$1.evaluate(POAFactory.java:205)
	at com.sun.corba.se.impl.orbutil.closure.Future.evaluate(Future.java:46)
	at com.sun.corba.se.impl.resolver.LocalResolverImpl.resolve(LocalResolverImpl.java:40)
	at com.sun.corba.se.impl.resolver.CompositeResolverImpl.resolve(CompositeResolverImpl.java:45)
	at com.sun.corba.se.impl.orb.ORBImpl.resolve_initial_references(ORBImpl.java:1169)
	at org.wildfly.iiop.openjdk.service.CorbaPOAService.start(CorbaPOAService.java:156)
	at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1714)
	at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1693)
	at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1540)
	at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
	at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1364)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.BindException: Address already in use
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.wildfly.iiop.openjdk.security.SocketFactoryBase.createServerSocket(SocketFactoryBase.java:59)
	at org.wildfly.iiop.openjdk.security.NoSSLSocketFactory.createServerSocket(NoSSLSocketFactory.java:50)
	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:161)
	... 19 more
{noformat}




> jboss.iiop-openjdk.poa-service.namingpoa service reload issues after server migration
> -------------------------------------------------------------------------------------
>
>                 Key: WFLY-10290
>                 URL: https://issues.jboss.org/browse/WFLY-10290
>             Project: WildFly
>          Issue Type: Bug
>          Components: IIOP, Migration
>            Reporter: Petr Kremensky
>            Assignee: Tomasz Adamski
>            Priority: Critical
>
> *jboss.iiop-openjdk.poa-service.namingpoa* service throws java.net.BindException: Address already in use upon server reload after manual migration from older EAP release.
> https://access.qa.redhat.com/documentation/en-us/red_hat_jboss_enterprise_application_platform/7.1/html-single/migration_guide/#management_cli_migration_operation
> The issue can be reproduced with EAP 7.1.0 as TARGET_HOME as well.
>    
> *steps to reproduce* with the current (720397b26d) wildfly master:
> {noformat}
> WORKSPACE=`pwd`
> CONFIG=standalone-full-ha.xml
> unzip -q jboss-eap-6.4.19.zip
> cp -r wildfly/dist/target/wildfly-13.0.0.Alpha1-SNAPSHOT wildfly
> SOURCE_HOME=${WORKSPACE}/jboss-eap-6.4
> TARGET_HOME=${WORKSPACE}/wildfly
> cp ${SOURCE_HOME}/standalone/configuration/${CONFIG} ${TARGET_HOME}/standalone/configuration
> ${TARGET_HOME}/bin/standalone.sh -c ${CONFIG} --start-mode=admin-only &
> ${TARGET_HOME}/bin/jboss-cli.sh --connect --controller=remote://localhost:9999
> # Migrate
> /subsystem=jacorb:migrate
> /subsystem=messaging:migrate
> /subsystem=web:migrate
> /subsystem=cmp:remove
> /extension=org.jboss.as.cmp:remove
> /subsystem=jaxr:remove
> /extension=org.jboss.as.jaxr:remove
> /subsystem=threads:remove
> /extension=org.jboss.as.threads:remove
> # Enable console logging
> /subsystem=logging/pattern-formatter=COLOR-PATTERN:add(pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%e%n")
> /subsystem=logging/console-handler=CONSOLE:add(level=INFO, named-formatter=COLOR-PATTERN)
> /subsystem=logging/root-logger=ROOT:add-handler(name=CONSOLE)
> # reload the server twice to get the exception
> reload
> reload
> {noformat}
>    
> *server log errors*
> {noformat}
> 12:01:52,041 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "iiop-openjdk")]) - failure description: {
>     "WFLYCTL0080: Failed services" => {"jboss.iiop-openjdk.poa-service.rootpoa" => "WFLYIIOP0098: Failed to resolve initial reference RootPOA
>     Caused by: org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
>     Caused by: java.net.BindException: Address already in use"},
>     "WFLYCTL0288: One or more services were unable to start due to one or more indirect dependencies not being available." => {
>         "Services that were unable to start:" => [
>             "jboss.iiop-openjdk.poa-service.irpoa",
>             "jboss.iiop-openjdk.poa-service.namingpoa"
>         ],
>         "Services that may be the cause:" => ["jboss.iiop-openjdk.poa-service.namingpoa"]
>     }
> }
> {noformat}
>    
> *Exception stack trace*
> {noformat}
> 12:01:51,881 SEVERE [javax.enterprise.resource.corba._DEFAULT_.rpc.transport] (MSC service thread 1-6) "IOP00410216: (COMM_FAILURE) Unable to create listener thread on the specified port: 3529": org.omg.CORBA.COMM_FAILURE:   vmcid: SUN  minor code: 216  completed: No
> 	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2632)
> 	at com.sun.corba.se.impl.logging.ORBUtilSystemException.createListenerFailed(ORBUtilSystemException.java:2651)
> 	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:164)
> 	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.getAcceptors(CorbaTransportManagerImpl.java:218)
> 	at com.sun.corba.se.impl.transport.CorbaTransportManagerImpl.addToIORTemplate(CorbaTransportManagerImpl.java:236)
> 	at com.sun.corba.se.spi.oa.ObjectAdapterBase.initializeTemplate(ObjectAdapterBase.java:122)
> 	at com.sun.corba.se.impl.oa.poa.POAImpl.initialize(POAImpl.java:404)
> 	at com.sun.corba.se.impl.oa.poa.POAImpl.makeRootPOA(POAImpl.java:272)
> 	at com.sun.corba.se.impl.oa.poa.POAFactory$1.evaluate(POAFactory.java:205)
> 	at com.sun.corba.se.impl.orbutil.closure.Future.evaluate(Future.java:46)
> 	at com.sun.corba.se.impl.resolver.LocalResolverImpl.resolve(LocalResolverImpl.java:40)
> 	at com.sun.corba.se.impl.resolver.CompositeResolverImpl.resolve(CompositeResolverImpl.java:45)
> 	at com.sun.corba.se.impl.orb.ORBImpl.resolve_initial_references(ORBImpl.java:1169)
> 	at org.wildfly.iiop.openjdk.service.CorbaPOAService.start(CorbaPOAService.java:156)
> 	at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1714)
> 	at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1693)
> 	at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1540)
> 	at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
> 	at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
> 	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
> 	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1364)
> 	at java.lang.Thread.run(Thread.java:748)
> Caused by: java.net.BindException: Address already in use
> 	at sun.nio.ch.Net.bind0(Native Method)
> 	at sun.nio.ch.Net.bind(Net.java:433)
> 	at sun.nio.ch.Net.bind(Net.java:425)
> 	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
> 	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> 	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
> 	at org.wildfly.iiop.openjdk.security.SocketFactoryBase.createServerSocket(SocketFactoryBase.java:59)
> 	at org.wildfly.iiop.openjdk.security.NoSSLSocketFactory.createServerSocket(NoSSLSocketFactory.java:50)
> 	at com.sun.corba.se.impl.transport.SocketOrChannelAcceptorImpl.initialize(SocketOrChannelAcceptorImpl.java:161)
> 	... 19 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.5.0#75005)


More information about the jboss-jira mailing list