[JBoss JIRA] (ISPN-8592) Random failures in module as-lucene-directory
by Gustavo Fernandes (JIRA)
Gustavo Fernandes created ISPN-8592:
---------------------------------------
Summary: Random failures in module as-lucene-directory
Key: ISPN-8592
URL: https://issues.jboss.org/browse/ISPN-8592
Project: Infinispan
Issue Type: Bug
Components: Test Suite - Query
Reporter: Gustavo Fernandes
Failures are only on CI. Output log:
{code}
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 321.235 s <<< FAILURE! - in org.infinispan.test.integration.as.wildfly.DirectoryProviderModuleMemberRegistrationIT
[ERROR] org.infinispan.test.integration.as.wildfly.DirectoryProviderModuleMemberRegistrationIT Time elapsed: 321.226 s <<< ERROR!
java.lang.RuntimeException: org.jboss.as.arquillian.container.ManagementClient$UnSuccessfulOperationException: "WFLYCTL0216: Management resource '[(\"deployment\" => \"DirectoryProviderModuleMemberRegistrationIT.war\")]' not found"
Caused by: org.jboss.as.arquillian.container.ManagementClient$UnSuccessfulOperationException: "WFLYCTL0216: Management resource '[(\"deployment\" => \"DirectoryProviderModuleMemberRegistrationIT.war\")]' not found"
{code}
The server logs shows that a service failed to be started by the server:
{noformat}
2017-12-06 14:51:19,095 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "iiop-openjdk")]) - failure description: {
"WFLYCTL0080: Failed services" => {"jboss.iiop-openjdk.orb-service" => "org.jboss.msc.service.StartException in service jboss.iiop-openjdk.orb-service: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
Caused by: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
Caused by: java.net.UnknownHostException: rhos-infinispan-slave-4.localdomain: rhos-infinispan-slave-4.localdomain: Name or service not known
Caused by: java.net.UnknownHostException: rhos-infinispan-slave-4.localdomain: Name or service not known"},
"WFLYCTL0412: Required services that are not installed:" => ["jboss.iiop-openjdk.orb-service"],
"WFLYCTL0180: Services with missing/unavailable dependencies" => undefined
}
2017-12-06 14:51:19,157 INFO [org.jboss.as.controller] (Controller Boot Thread) WFLYCTL0183: Service status report
WFLYCTL0186: Services which failed to start: service jboss.iiop-openjdk.orb-service: org.jboss.msc.service.StartException in service jboss.iiop-openjdk.orb-service: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
{noformat}
But it is not clear if this is the cause of the deployment failure.
There's a ulterior timeout when waiting for deployment:
{noformat}
2017-12-06 14:51:25,090 INFO [org.jboss.as.repository] (management-handler-thread - 1)
WFLYDR0001: Content added at location /home/infinispan/workspace/Infinispan_PR-5617-
KXLXQD6B5FUFQGJ2K2VQLLZ5ZMSCMY2P3T7KOX6BR7KEIKKJDWNA/integrationtests
/as-lucene-directory/target/node1/wildfly-10.1.0.Final/standalone/data/content
/2f/ad86f43e81775bc0ac8c4a58d586286f022e3f/content
2017-12-06 14:51:25,106 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2)
WFLYSRV0027: Starting deployment of
"DirectoryProviderModuleMemberRegistrationIT.war" (runtime-name:
"DirectoryProviderModuleMemberRegistrationIT.war")
{noformat}
{noformat}
2017-12-06 14:56:25,100 ERROR [org.jboss.as.controller.management-operation]
(management-handler-thread - 1) WFLYCTL0348: Timeout after [300] seconds waiting for
service container stability. Operation will roll back. Step that first updated the service
container was 'deploy' at address '[("deployment" =>
"DirectoryProviderModuleMemberRegistrationIT.war")]'
2017-12-06 14:56:25,101 ERROR [org.jboss.as.server] (management-handler-thread - 1)
WFLYSRV0022: Deploy of deployment "DirectoryProviderModuleMemberRegistrationIT.war"
was rolled back with no failure message
2017-12-06 14:56:30,102 ERROR [org.jboss.as.controller.management-operation]
(management-handler-thread - 1) WFLYCTL0190: Step handler
org.jboss.as.server.deployment.DeploymentHandlerUtil$1@65e7ceaa for operation
{"operation" => "deploy","address" => [("deployment" =>
"DirectoryProviderModuleMemberRegistrationIT.war")],"operation-headers" => {"caller-type"
=> "user","access-mechanism" => "NATIVE"}} at address [("deployment" =>
"DirectoryProviderModuleMemberRegistrationIT.war")] failed handling operation rollback --
java.util.concurrent.TimeoutException: java.util.concurrent.TimeoutException
{noformat}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 4 months
[JBoss JIRA] (ISPN-8592) Random failures in module as-lucene-directory
by Gustavo Fernandes (JIRA)
[ https://issues.jboss.org/browse/ISPN-8592?page=com.atlassian.jira.plugin.... ]
Gustavo Fernandes reassigned ISPN-8592:
---------------------------------------
Assignee: Gustavo Fernandes
> Random failures in module as-lucene-directory
> ---------------------------------------------
>
> Key: ISPN-8592
> URL: https://issues.jboss.org/browse/ISPN-8592
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Query
> Reporter: Gustavo Fernandes
> Assignee: Gustavo Fernandes
>
> Failures are only on CI. Output log:
> {code}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 321.235 s <<< FAILURE! - in org.infinispan.test.integration.as.wildfly.DirectoryProviderModuleMemberRegistrationIT
> [ERROR] org.infinispan.test.integration.as.wildfly.DirectoryProviderModuleMemberRegistrationIT Time elapsed: 321.226 s <<< ERROR!
> java.lang.RuntimeException: org.jboss.as.arquillian.container.ManagementClient$UnSuccessfulOperationException: "WFLYCTL0216: Management resource '[(\"deployment\" => \"DirectoryProviderModuleMemberRegistrationIT.war\")]' not found"
> Caused by: org.jboss.as.arquillian.container.ManagementClient$UnSuccessfulOperationException: "WFLYCTL0216: Management resource '[(\"deployment\" => \"DirectoryProviderModuleMemberRegistrationIT.war\")]' not found"
> {code}
> The server logs shows that a service failed to be started by the server:
> {noformat}
> 2017-12-06 14:51:19,095 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "iiop-openjdk")]) - failure description: {
> "WFLYCTL0080: Failed services" => {"jboss.iiop-openjdk.orb-service" => "org.jboss.msc.service.StartException in service jboss.iiop-openjdk.orb-service: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
> Caused by: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
> Caused by: java.net.UnknownHostException: rhos-infinispan-slave-4.localdomain: rhos-infinispan-slave-4.localdomain: Name or service not known
> Caused by: java.net.UnknownHostException: rhos-infinispan-slave-4.localdomain: Name or service not known"},
> "WFLYCTL0412: Required services that are not installed:" => ["jboss.iiop-openjdk.orb-service"],
> "WFLYCTL0180: Services with missing/unavailable dependencies" => undefined
> }
> 2017-12-06 14:51:19,157 INFO [org.jboss.as.controller] (Controller Boot Thread) WFLYCTL0183: Service status report
> WFLYCTL0186: Services which failed to start: service jboss.iiop-openjdk.orb-service: org.jboss.msc.service.StartException in service jboss.iiop-openjdk.orb-service: org.omg.CORBA.INTERNAL: vmcid: SUN minor code: 208 completed: No
> {noformat}
> But it is not clear if this is the cause of the deployment failure.
> There's a ulterior timeout when waiting for deployment:
> {noformat}
> 2017-12-06 14:51:25,090 INFO [org.jboss.as.repository] (management-handler-thread - 1)
> WFLYDR0001: Content added at location /home/infinispan/workspace/Infinispan_PR-5617-
> KXLXQD6B5FUFQGJ2K2VQLLZ5ZMSCMY2P3T7KOX6BR7KEIKKJDWNA/integrationtests
> /as-lucene-directory/target/node1/wildfly-10.1.0.Final/standalone/data/content
> /2f/ad86f43e81775bc0ac8c4a58d586286f022e3f/content
> 2017-12-06 14:51:25,106 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2)
> WFLYSRV0027: Starting deployment of
> "DirectoryProviderModuleMemberRegistrationIT.war" (runtime-name:
> "DirectoryProviderModuleMemberRegistrationIT.war")
> {noformat}
> {noformat}
> 2017-12-06 14:56:25,100 ERROR [org.jboss.as.controller.management-operation]
> (management-handler-thread - 1) WFLYCTL0348: Timeout after [300] seconds waiting for
> service container stability. Operation will roll back. Step that first updated the service
> container was 'deploy' at address '[("deployment" =>
> "DirectoryProviderModuleMemberRegistrationIT.war")]'
> 2017-12-06 14:56:25,101 ERROR [org.jboss.as.server] (management-handler-thread - 1)
> WFLYSRV0022: Deploy of deployment "DirectoryProviderModuleMemberRegistrationIT.war"
> was rolled back with no failure message
> 2017-12-06 14:56:30,102 ERROR [org.jboss.as.controller.management-operation]
> (management-handler-thread - 1) WFLYCTL0190: Step handler
> org.jboss.as.server.deployment.DeploymentHandlerUtil$1@65e7ceaa for operation
> {"operation" => "deploy","address" => [("deployment" =>
> "DirectoryProviderModuleMemberRegistrationIT.war")],"operation-headers" => {"caller-type"
> => "user","access-mechanism" => "NATIVE"}} at address [("deployment" =>
> "DirectoryProviderModuleMemberRegistrationIT.war")] failed handling operation rollback --
> java.util.concurrent.TimeoutException: java.util.concurrent.TimeoutException
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 4 months
[JBoss JIRA] (ISPN-7098) FunctionalDistributionTest.testDistributionFromPrimaryOwner random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7098?page=com.atlassian.jira.plugin.... ]
Dan Berindei commented on ISPN-7098:
------------------------------------
Found a very similar stack trace in CI today:
{noformat}
[ERROR] testDistributionFromPrimaryOwner(org.infinispan.functional.FunctionalDistributionTest) Time elapsed: 0.007 s <<< FAILURE!
java.lang.NullPointerException
at org.infinispan.functional.FunctionalDistributionTest.lambda$iterate$8(FunctionalDistributionTest.java:97)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1380)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.infinispan.functional.FunctionalDistributionTest.iterate(FunctionalDistributionTest.java:98)
at org.infinispan.functional.FunctionalDistributionTest.doTestDistribution(FunctionalDistributionTest.java:77)
at org.infinispan.functional.FunctionalDistributionTest.testDistributionFromPrimaryOwner(FunctionalDistributionTest.java:43)
{noformat}
> FunctionalDistributionTest.testDistributionFromPrimaryOwner random failures
> ---------------------------------------------------------------------------
>
> Key: ISPN-7098
> URL: https://issues.jboss.org/browse/ISPN-7098
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 9.0.0.Alpha4
> Reporter: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.2.0.Final
>
>
> {{FunctionalDistributionTest.testDistributionFromPrimaryOwner}} assumes 100ms is enough for the command to be executed on both backup owners, but that's not always true -- e.g. when TRACE logging is enabled.
> {noformat}
> 15:27:36,079 TRACE (async-thread-Test-NodeC-p36570-t1:[]) [InvocationContextInterceptor] Invoked with command ReadWriteKeyCommand {key=testDistributionFromPrimaryOwner, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@44ffeec2]
> 15:27:36,124 TRACE (async-thread-Test-NodeC-p36570-t1:[]) [JGroupsTransport] dests=[Test-NodeC-21089, Test-NodeD-31203], command=SingleRpcCommand{cacheName='dist', command=ReadWriteKeyCommand {key=testDistributionFromPrimaryOwner, flags=[]}}, mode=ASYNCHRONOUS, timeout=15000
> 15:27:36,140 TRACE (async-thread-Test-NodeC-p36570-t1:[]) [DefaultDataContainer] Store MetadataImmortalCacheEntry{key=testDistributionFromPrimaryOwner, value=1, metadata=MetaParamsInternalMetadata{params=MetaParams{metas=[]}}} in container
> 15:27:36,144 TRACE (Incoming-1,Test-NodeD-31203:[]) [InvocationContextInterceptor] Invoked with command ReadWriteKeyCommand {key=testDistributionFromPrimaryOwner, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@73111d9]
> 15:27:36,241 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.functional.FunctionalDistributionTest.testDistributionFromPrimaryOwner
> java.lang.NullPointerException
> at org.infinispan.functional.FunctionalDistributionTest.lambda$iterate$8(FunctionalDistributionTest.java:101) ~[test-classes/:?]
> at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_101]
> at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_101]
> at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_101]
> at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374) ~[?:1.8.0_101]
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_101]
> at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_101]
> at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_101]
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_101]
> at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_101]
> at org.infinispan.functional.FunctionalDistributionTest.iterate(FunctionalDistributionTest.java:102) ~[test-classes/:?]
> at org.infinispan.functional.FunctionalDistributionTest.doTestDistribution(FunctionalDistributionTest.java:80) ~[test-classes/:?]
> at org.infinispan.functional.FunctionalDistributionTest.testDistributionFromPrimaryOwner(FunctionalDistributionTest.java:46) ~[test-classes/:?]
> 15:27:36,259 TRACE (Incoming-1,Test-NodeD-31203:[]) [DefaultDataContainer] Store MetadataImmortalCacheEntry{key=testDistributionFromPrimaryOwner, value=1, metadata=MetaParamsInternalMetadata{params=MetaParams{metas=[]}}} in container
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 4 months
[JBoss JIRA] (ISPN-8590) Operations Code from client to server should be a short
by Katia Aresti (JIRA)
[ https://issues.jboss.org/browse/ISPN-8590?page=com.atlassian.jira.plugin.... ]
Katia Aresti updated ISPN-8590:
-------------------------------
Description:
Hotrod operations sent from the client to the server are today read like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
New hotrod operations and the needed request codes won't enter in a byte soon, so this should be changed
was:
Hotrod operations sent from the client to the server are today read like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
New hotrod operations and request codes won't enter in a byte soon.
> Operations Code from client to server should be a short
> -------------------------------------------------------
>
> Key: ISPN-8590
> URL: https://issues.jboss.org/browse/ISPN-8590
> Project: Infinispan
> Issue Type: Enhancement
> Components: Hot Rod
> Reporter: Katia Aresti
> Assignee: Katia Aresti
>
> Hotrod operations sent from the client to the server are today read like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
> New hotrod operations and the needed request codes won't enter in a byte soon, so this should be changed
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 4 months
[JBoss JIRA] (ISPN-8590) Operations Code from client to server should be a short
by Katia Aresti (JIRA)
[ https://issues.jboss.org/browse/ISPN-8590?page=com.atlassian.jira.plugin.... ]
Katia Aresti updated ISPN-8590:
-------------------------------
Description:
Hotrod operations sent from the client to the server are today treated like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
New hotrod operations and request codes won't enter in a byte soon.
was:
Hotrod operations send from the client to the server are today treated like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
New hotrod operations and request codes won't enter in a byte soon.
> Operations Code from client to server should be a short
> -------------------------------------------------------
>
> Key: ISPN-8590
> URL: https://issues.jboss.org/browse/ISPN-8590
> Project: Infinispan
> Issue Type: Enhancement
> Components: Hot Rod
> Reporter: Katia Aresti
> Assignee: Katia Aresti
>
> Hotrod operations sent from the client to the server are today treated like byte (this is not the case concerning responses codes, that are read like short from the hotrod client).
> New hotrod operations and request codes won't enter in a byte soon.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 4 months