Brian Stansberry created WFLY-13929: --------------------------------------- Summary: Intermittent failures in https://ci.wildfly.org/project.html?projectId=WF_PullRequest&buildTyp... Key: WFLY-13929 URL: https://issues.redhat.com/browse/WFLY-13929 Project: WildFly Issue Type: Bug Components: Management Reporter: Brian Stansberry Assignee: Jeff Mesnil Two tests in DeploymentOverlayCLITestCase are failing intermittently but fairly often, e.g. https://ci.wildfly.org/viewLog.html?buildId=225079&tab=buildResultsDi... {code} java.lang.RuntimeException: java.io.IOException: User limit of inotify instances reached or too many open files at org.xnio.nio.WatchServiceFileSystemWatcher.&lt;init&gt;(WatchServiceFileSystemWatcher.java:75) at org.xnio.nio.NioXnio.createFileSystemWatcher(NioXnio.java:241) at io.undertow.server.handlers.resource.PathResourceManager.registerResourceChangeListener(PathResourceManager.java:256) at org.wildfly.extension.undertow.deployment.ServletResourceManager.registerResourceChangeListener(ServletResourceManager.java:117) at io.undertow.server.handlers.resource.CachingResourceManager.registerResourceChangeListener(CachingResourceManager.java:131) at io.undertow.servlet.core.ManagedServlet$DefaultInstanceStrategy.start(ManagedServlet.java:310) at io.undertow.servlet.core.ManagedServlet.forceInit(ManagedServlet.java:212) at io.undertow.servlet.handlers.ServletChain.forceInit(ServletChain.java:130) at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:63) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.deployment.GlobalRequestControllerHandler.handleRequest(GlobalRequestControllerHandler.java:68) at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:269) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:78) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:133) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:130) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:249) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:78) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:99) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:387) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:841) at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1990) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377) at org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1280) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: User limit of inotify instances reached or too many open files at sun.nio.fs.LinuxWatchService.&lt;init&gt;(LinuxWatchService.java:64) at sun.nio.fs.LinuxFileSystem.newWatchService(LinuxFileSystem.java:47) at org.xnio.nio.WatchServiceFileSystemWatcher.&lt;init&gt;(WatchServiceFileSystemWatcher.java:73) ... 49 more </pre></body></html> at org.jboss.as.test.integration.common.HttpRequest.execute(HttpRequest.java:61) at org.jboss.as.test.integration.common.HttpRequest.get(HttpRequest.java:82) at org.jboss.as.test.integration.management.cli.DeploymentOverlayCLITestCase.simpleOverrideInEarAtWarLevelExplodedTest(DeploymentOverlayCLITestCase.java:415) at org.jboss.as.test.integration.management.cli.DeploymentOverlayCLITestCase.testSimpleOverrideInEarAtWarLevelExploded(DeploymentOverlayCLITestCase.java:383) {code} Tests started failing fairly often on September 17. https://ci.wildfly.org/project.html?projectId=WF_PullRequest&buildTyp... The first failure was against a PR that hasn't been merged yet, so it's likely the problem is in master, not one of the PRs shown on that page. -- This message was sent by Atlassian Jira (v7.13.8#713008)