ReconnectSyslogServerTestCase from wf-core fails intermittently --------------------------------------------------------------- Key: WFCORE-1708 URL: https://issues.jboss.org/browse/WFCORE-1708 Project: WildFly Core Issue Type: Bug Components: Test Suite Affects Versions: 3.0.0.Alpha4 Reporter: Ondrej Lukas Assignee: Ondrej Lukas Fix For: 3.0.0.Alpha5 *Description of problem:* ReconnectSyslogServerTestCase from wf-core fails intermittently. *How reproducible:* 2% *Actual results:* Stacktrace: {noformat} java.lang.AssertionError: No message was logged into the TCP syslog after second syslog server restart at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertNotNull(Assert.java:712) at org.jboss.as.test.manualmode.logging.ReconnectSyslogServerTestCase.testReconnectSyslogServer(ReconnectSyslogServerTestCase.java:118) {noformat} Standard Output: {noformat} 10:59:13,639 INFO [org.wildfly.core.testrunner.Server] (main) Starting container with: /qa/tools/opt/x86_64/jdk1.8.0_91/jre/bin/java -D[Standalone] -javaagent:/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/eap-local-maven-repository/org/jboss/byteman/byteman/3.0.3/byteman-3.0.3.jar=port:9091,boot:/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/eap-local-maven-repository/org/jboss/byteman/byteman/3.0.3/byteman-3.0.3.jar,sys:/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/shared/target/wildfly-core-testsuite-shared-3.0.0.Alpha4-redhat-1.jar -Dorg.jboss.byteman.transform.all -Dorg.jboss.byteman.verbose=true -Dmaven.repo.local=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/eap-local-maven-repository -Xmx512m -XX:MaxMetaspaceSize=256m -Djboss.dist=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false -server -Dts.timeout.factor=100 -Djbossas.ts.dir=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode -ea -Dorg.jboss.boot.log.file=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/log/server.log -Dlogging.configuration=file:/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/configuration/logging.properties -jar /mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/jboss-modules.jar -mp /mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/modules org.jboss.as.standalone -Djboss.home.dir=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core -Djboss.server.base.dir=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone -Djboss.server.log.dir=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/log -Djboss.server.config.dir=/mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/configuration -c=standalone.xml -bmanagement=10.16.180.146 -Djboss.http.port=8080 -Djboss.bind.address=10.16.180.146 10:59:13,849 INFO [org.xnio] (main) XNIO version 3.4.0.Beta2 10:59:13,950 INFO [org.xnio.nio] (main) XNIO NIO Implementation Version 3.4.0.Beta2 TransformListener() : accepting requests on localhost:9091 10:59:14,238 INFO [org.jboss.remoting] (main) JBoss Remoting version 4.0.21.Final-redhat-1 &amp#27;[0m10:59:15,448 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final-redhat-1 &amp#27;[0m&amp#27;[0m10:59:16,071 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final-redhat-1 &amp#27;[0m&amp#27;[0m10:59:16,385 INFO [org.jboss.as] (MSC service thread 1-2) WFLYSRV0049: WildFly Core 3.0.0.Alpha4-redhat-1 "Kenny" starting &amp#27;[0m&amp#27;[0m10:59:17,878 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http) &amp#27;[0m&amp#27;[0m10:59:17,983 INFO [org.xnio] (MSC service thread 1-2) XNIO version 3.4.0.Beta2 &amp#27;[0m&amp#27;[0m10:59:18,004 INFO [org.xnio.nio] (MSC service thread 1-2) XNIO NIO Implementation Version 3.4.0.Beta2 &amp#27;[0m&amp#27;[0m10:59:18,144 INFO [org.jboss.as.patching] (MSC service thread 1-1) WFLYPAT0050: WildFly cumulative patch ID is: base, one-off patches include: none &amp#27;[0m&amp#27;[0m10:59:18,180 INFO [org.jboss.remoting] (MSC service thread 1-2) JBoss Remoting version 4.0.21.Final-redhat-1 &amp#27;[0m&amp#27;[33m10:59:18,208 WARN [org.jboss.as.domain.management.security] (MSC service thread 1-1) WFLYDM0111: Keystore /mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost &amp#27;[0m&amp#27;[33m10:59:18,352 WARN [org.jboss.as.domain.http.api.undertow] (MSC service thread 1-1) WFLYDMHTTP0003: Unable to load console module for slot main, disabling console &amp#27;[0m&amp#27;[0m10:59:18,924 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://10.16.180.146:9990/management &amp#27;[0m&amp#27;[0m10:59:18,925 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://10.16.180.146:9990 &amp#27;[0m&amp#27;[0m10:59:18,925 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: WildFly Core 3.0.0.Alpha4-redhat-1 "Kenny" started in 4551ms - Started 59 of 62 services (20 services are lazy, passive or on-demand) &amp#27;[0m&amp#27;[0m10:59:19,841 INFO [org.jboss.as.repository] (management-handler-thread - 2) WFLYDR0001: Content added at location /mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/data/content/b6/795345f1851ba393f4f56dcd0e08328efcc090/content &amp#27;[0m&amp#27;[0m10:59:19,880 INFO [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0027: Starting deployment of "logging-test.jar" (runtime-name: "logging-test.jar") &amp#27;[0m&amp#27;[0m10:59:20,076 INFO [org.wildfly.test.undertow.UndertowService] (MSC service thread 1-2) Started Undertow on 10.16.180.146:8080 &amp#27;[0m&amp#27;[0m10:59:20,131 INFO [org.jboss.as.server] (management-handler-thread - 2) WFLYSRV0010: Deployed "logging-test.jar" (runtime-name : "logging-test.jar") &amp#27;[0m&amp#27;[0m10:59:27,185 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-1) someLogMessage &amp#27;[0m10:59:27,739 WARN [org.jboss.as.test.syslogserver.UDPSyslogServer] (SyslogServer: udp) SocketException occurred: java.net.SocketException: Socket closed at java.net.PlainDatagramSocketImpl.receive0(Native Method) at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:143) at java.net.DatagramSocket.receive(DatagramSocket.java:812) at org.jboss.as.test.syslogserver.UDPSyslogServer.run(UDPSyslogServer.java:62) at java.lang.Thread.run(Thread.java:745) 10:59:28,239 ERROR [org.jboss.as.test.syslogserver.TCPSyslogServer] (SyslogServer: tcp) IOException occurred.: java.net.SocketException: Socket closed at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409) at java.net.ServerSocket.implAccept(ServerSocket.java:545) at java.net.ServerSocket.accept(ServerSocket.java:513) at org.jboss.as.test.syslogserver.TCPSyslogServer.run(TCPSyslogServer.java:55) at java.lang.Thread.run(Thread.java:745) 10:59:28,241 WARN [org.jboss.as.test.syslogserver.TCPSyslogSocketHandler] (Thread-6) IOException occurred: java.net.SocketException: Socket closed at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read(BufferedInputStream.java:265) at org.jboss.as.test.syslogserver.TCPSyslogSocketHandler.run(TCPSyslogSocketHandler.java:73) at java.lang.Thread.run(Thread.java:745) &amp#27;[0m10:59:28,255 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-1) someLogMessage &amp#27;[0mLogManager error of type WRITE_FAILURE: Error writing to TCP stream java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109) at java.net.SocketOutputStream.write(SocketOutputStream.java:153) at org.jboss.logmanager.handlers.TcpOutputStream.write(TcpOutputStream.java:182) at org.jboss.logmanager.handlers.TcpOutputStream.write(TcpOutputStream.java:173) at org.jboss.logmanager.handlers.SyslogHandler.sendMessage(SyslogHandler.java:579) at org.jboss.logmanager.handlers.SyslogHandler.doPublish(SyslogHandler.java:540) at org.jboss.logmanager.ExtHandler.publish(ExtHandler.java:76) at org.jboss.logmanager.LoggerNode.publish(LoggerNode.java:314) at org.jboss.logmanager.LoggerNode.publish(LoggerNode.java:322) at org.jboss.logmanager.Logger.logRaw(Logger.java:850) at org.jboss.logmanager.Logger.log(Logger.java:802) at org.jboss.logmanager.Logger.log(Logger.java:814) at org.jboss.logging.JBossLogManagerLogger.doLog(JBossLogManagerLogger.java:42) at org.jboss.logging.Logger.info(Logger.java:955) at org.jboss.as.test.manualmode.logging.LoggingServiceActivator$1.handleRequest(LoggingServiceActivator.java:50) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.protocol.http.HttpReadListener.handleEventWithNoRunningRequest(HttpReadListener.java:233) at io.undertow.server.protocol.http.HttpReadListener.handleEvent(HttpReadListener.java:131) at io.undertow.server.protocol.http.HttpReadListener.handleEvent(HttpReadListener.java:57) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92) at org.xnio.conduits.ReadReadyHandler$ChannelListenerHandler.readReady(ReadReadyHandler.java:66) at org.xnio.nio.NioSocketConduit.handleReady(NioSocketConduit.java:89) at org.xnio.nio.WorkerThread.run(WorkerThread.java:565) &amp#27;[0m10:59:28,263 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-2) someLogMessage &amp#27;[0m&amp#27;[0m10:59:36,291 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-1) someLogMessage &amp#27;[0m10:59:36,794 WARN [org.jboss.as.test.syslogserver.UDPSyslogServer] (SyslogServer: udp) SocketException occurred: java.net.SocketException: Socket closed at java.net.PlainDatagramSocketImpl.receive0(Native Method) at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:143) at java.net.DatagramSocket.receive(DatagramSocket.java:812) at org.jboss.as.test.syslogserver.UDPSyslogServer.run(UDPSyslogServer.java:62) at java.lang.Thread.run(Thread.java:745) 10:59:37,295 ERROR [org.jboss.as.test.syslogserver.TCPSyslogServer] (SyslogServer: tcp) IOException occurred.: java.net.SocketException: Socket closed at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409) at java.net.ServerSocket.implAccept(ServerSocket.java:545) at java.net.ServerSocket.accept(ServerSocket.java:513) at org.jboss.as.test.syslogserver.TCPSyslogServer.run(TCPSyslogServer.java:55) at java.lang.Thread.run(Thread.java:745) &amp#27;[0m10:59:37,298 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-2) someLogMessage &amp#27;[0m&amp#27;[0m10:59:37,310 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-1) someLogMessage &amp#27;[0m10:59:37,313 ERROR [org.jboss.as.test.syslogserver.Rfc5424SyslogEvent] (Thread-9) Can't parse priority 10:59:37,313 WARN [org.jboss.as.test.syslogserver.TCPSyslogSocketHandler] (Thread-9) IOException occurred: java.net.SocketException: Socket closed at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read(BufferedInputStream.java:265) at org.jboss.as.test.syslogserver.TCPSyslogSocketHandler.run(TCPSyslogSocketHandler.java:73) at java.lang.Thread.run(Thread.java:745) &amp#27;[0m10:59:45,316 INFO [org.jboss.as.test.manualmode.logging.LoggingServiceActivator] (XNIO-1 I/O-2) someLogMessage &amp#27;[0m10:59:50,955 WARN [org.jboss.as.test.syslogserver.UDPSyslogServer] (SyslogServer: udp) SocketException occurred: java.net.SocketException: Socket closed at java.net.PlainDatagramSocketImpl.receive0(Native Method) at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:143) at java.net.DatagramSocket.receive(DatagramSocket.java:812) at org.jboss.as.test.syslogserver.UDPSyslogServer.run(UDPSyslogServer.java:62) at java.lang.Thread.run(Thread.java:745) 10:59:51,456 ERROR [org.jboss.as.test.syslogserver.TCPSyslogServer] (SyslogServer: tcp) IOException occurred.: java.net.SocketException: Socket closed at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409) at java.net.ServerSocket.implAccept(ServerSocket.java:545) at java.net.ServerSocket.accept(ServerSocket.java:513) at org.jboss.as.test.syslogserver.TCPSyslogServer.run(TCPSyslogServer.java:55) at java.lang.Thread.run(Thread.java:745) &amp#27;[0m10:59:51,517 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2) WFLYSRV0028: Stopped deployment logging-test.jar (runtime-name: logging-test.jar) in 17ms &amp#27;[0m&amp#27;[33m10:59:51,525 WARN [org.jboss.as.controller] (management-handler-thread - 1) WFLYCTL0357: Notification of type deployment-undeployed is not described for the resource at the address [] &amp#27;[0m&amp#27;[0m10:59:51,527 INFO [org.jboss.as.repository] (management-handler-thread - 1) WFLYDR0002: Content removed from location /mnt/hudson_workspace/workspace/eap-7x-as-testsuite-test-core/0728bde1/testsuite/manualmode/target/wildfly-core/standalone/data/content/b6/795345f1851ba393f4f56dcd0e08328efcc090/content &amp#27;[0m&amp#27;[0m10:59:51,528 INFO [org.jboss.as.server] (management-handler-thread - 1) WFLYSRV0009: Undeployed "logging-test.jar" (runtime-name: "logging-test.jar") &amp#27;[0m&amp#27;[0m10:59:51,549 INFO [org.jboss.as.server] (management-handler-thread - 2) WFLYSRV0236: Suspending server with no timeout. &amp#27;[0m&amp#27;[0m10:59:51,552 INFO [org.jboss.as.server] (Management Triggered Shutdown) WFLYSRV0241: Shutting down in response to management operation 'shutdown' &amp#27;[0m&amp#27;[0m10:59:51,704 INFO [org.jboss.as] (MSC service thread 1-2) WFLYSRV0050: WildFly Core 3.0.0.Alpha4-redhat-1 "Kenny" stopped in 97ms &amp#27;[0m {noformat} Standard Error Output: {noformat} Exception in thread "Thread-13" java.lang.NullPointerException at org.wildfly.core.testrunner.Server.lambda$stop$0(Server.java:184) at java.lang.Thread.run(Thread.java:745) {noformat} *Expected results:* No errors *Additional info:* Links to jenkins reports: * https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/EAP7/view/EAP7-AS-T... * https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-7x-as-testsuite-...