[JBoss JIRA] (ISPN-7167) ExampleConfigsIT.testTopologyConfigRackAttribute random failures
by Dan Berindei (JIRA)
Dan Berindei created ISPN-7167:
----------------------------------
Summary: ExampleConfigsIT.testTopologyConfigRackAttribute random failures
Key: ISPN-7167
URL: https://issues.jboss.org/browse/ISPN-7167
Project: Infinispan
Issue Type: Bug
Components: Test Suite - Server
Affects Versions: 9.0.0.Alpha4
Reporter: Dan Berindei
Priority: Critical
Fix For: 9.0.0.Beta1
{noformat}
java.lang.AssertionError: Unexpected number of entries in server1: 0
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.infinispan.server.test.configs.ExampleConfigsIT.verifyTopologyHinting(ExampleConfigsIT.java:482)
at org.infinispan.server.test.configs.ExampleConfigsIT.testTopologyConfigRackAttribute(ExampleConfigsIT.java:419)
{noformat}
The test is also inconsistent about the names of the servers, sometimes it starts counting from 0 and sometimes it starts counting from 1.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-7116) Test methods that use a TestNg dataProvider are duplicated in JUnit reports
by Alan Field (JIRA)
[ https://issues.jboss.org/browse/ISPN-7116?page=com.atlassian.jira.plugin.... ]
Alan Field commented on ISPN-7116:
----------------------------------
I have made some progress, but I'm not there yet. I have modified `org.infinispan.commons.test.TestNGTestListener.testName()` to properly handle parameters and updated code to the latest version of TestNg, and this produces the correct output on the console when running the tests. I am still unable to figure out which reported is used during a Surefire execution of the tests to generate the XML files. I have tried setting breakpoints in both the Surefire and TestNg reporters, but I never get into the debugger. I'll keep looking...
> Test methods that use a TestNg dataProvider are duplicated in JUnit reports
> ---------------------------------------------------------------------------
>
> Key: ISPN-7116
> URL: https://issues.jboss.org/browse/ISPN-7116
> Project: Infinispan
> Issue Type: Enhancement
> Components: Test Suite - Core
> Reporter: Alan Field
> Assignee: Alan Field
>
> TestNg test methods that use a {{dataProvider}} are reported as multiple duplicate test cases in the surefire results reports:
> {noformat}
> <testcase name="testDistExecPutGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.424"/>
> <testcase name="testDistExecPutGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.015"/>
> <testcase name="testEmbeddedScriptRemoteExecution" classname="org.infinispan.client.hotrod.ExecTest" time="0.132"/>
> <testcase name="testEmbeddedScriptRemoteExecution" classname="org.infinispan.client.hotrod.ExecTest" time="0.086"/>
> <testcase name="testExecPutConstantGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.016"/>
> <testcase name="testExecPutConstantGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.009"/>
> <testcase name="testExecReturnNull" classname="org.infinispan.client.hotrod.ExecTest" time="0.015"/>
> <testcase name="testExecReturnNull" classname="org.infinispan.client.hotrod.ExecTest" time="0.008"/>
> <testcase name="testLocalExecPutGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.022"/>
> <testcase name="testLocalExecPutGet" classname="org.infinispan.client.hotrod.ExecTest" time="0.013"/>
> <testcase name="testLocalExecPutGetWithListener" classname="org.infinispan.client.hotrod.ExecTest" time="0.037"/>
> <testcase name="testLocalExecPutGetWithListener" classname="org.infinispan.client.hotrod.ExecTest" time="0.025"/>
> <testcase name="testRemoteScriptRemoteExecution" classname="org.infinispan.client.hotrod.ExecTest" time="0.074"/>
> <testcase name="testRemoteScriptRemoteExecution" classname="org.infinispan.client.hotrod.ExecTest" time="0.06"/>
> <testcase name="testRemovingNonExistentScript" classname="org.infinispan.client.hotrod.ExecTest" time="0.002"/>
> {noformat}
> The {{name}} property should include the parameters passed to the method to differentiate the results.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-6439) Improve stability of ExampleConfigsIT.testLevelDBCacheStoreConfig
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-6439?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-6439:
-------------------------------
Labels: testsuite_stability (was: )
> Improve stability of ExampleConfigsIT.testLevelDBCacheStoreConfig
> -----------------------------------------------------------------
>
> Key: ISPN-6439
> URL: https://issues.jboss.org/browse/ISPN-6439
> Project: Infinispan
> Issue Type: Bug
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
> Priority: Minor
> Labels: testsuite_stability
>
> http://ci.infinispan.org/viewLog.html?buildId=37942&tab=buildResultsDiv&b...
> {code}
> java.lang.AssertionError: expected:<v0> but was:<null>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.infinispan.server.test.configs.ExampleConfigsIT.doPutGet(ExampleConfigsIT.java:660)
> at org.infinispan.server.test.configs.ExampleConfigsIT.doPutGetCheckPath(ExampleConfigsIT.java:667)
> at org.infinispan.server.test.configs.ExampleConfigsIT.testLevelDBCacheStoreConfig(ExampleConfigsIT.java:297)
> ------- Stdout: -------
> &#27;[0m18:34:35,724 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.1.Final
> &#27;[0m&#27;[0m18:34:35,974 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> &#27;[0m&#27;[0m18:34:36,084 INFO [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) starting
> &#27;[0m&#27;[0m18:34:37,773 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
> &#27;[0m&#27;[0m18:34:37,806 INFO [org.xnio] (MSC service thread 1-5) XNIO version 3.3.4.Final
> &#27;[0m&#27;[0m18:34:37,820 INFO [org.xnio.nio] (MSC service thread 1-5) XNIO NIO Implementation Version 3.3.4.Final
> &#27;[0m&#27;[0m18:34:37,888 INFO [org.jboss.remoting] (MSC service thread 1-5) JBoss Remoting version 4.0.18.Final
> &#27;[0m&#27;[0m18:34:37,897 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 19) Activating Infinispan subsystem.
> &#27;[0m&#27;[0m18:34:37,920 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 21) WFLYIO001: Worker 'default' has auto-configured to 8 core threads with 64 task threads based on your 4 available processors
> &#27;[0m&#27;[0m18:34:37,979 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 25) WFLYNAM0001: Activating Naming Subsystem
> &#27;[0m&#27;[33m18:34:37,994 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 29) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.
> &#27;[0m&#27;[0m18:34:38,008 INFO [org.jboss.as.connector] (MSC service thread 1-3) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.2.Final)
> &#27;[0m&#27;[0m18:34:38,013 INFO [org.jboss.as.security] (ServerService Thread Pool -- 27) WFLYSEC0002: Activating Security Subsystem
> &#27;[0m&#27;[0m18:34:38,051 INFO [org.jboss.as.security] (MSC service thread 1-6) WFLYSEC0001: Current PicketBox version=4.9.4.Final
> &#27;[0m&#27;[0m18:34:38,086 INFO [org.jboss.as.naming] (MSC service thread 1-4) WFLYNAM0003: Starting Naming Service
> &#27;[0m&#27;[0m18:34:38,146 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 18) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
> &#27;[0m&#27;[0m18:34:38,163 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0018: Started Driver service with driver-name = h2
> &#27;[0m&#27;[0m18:34:38,549 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-8) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
> &#27;[0m&#27;[0m18:34:38,570 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:38,685 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0027: Starting deployment of "custom-store.jar" (runtime-name: "custom-store.jar")
> &#27;[0m&#27;[0m18:34:38,693 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-4) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/buildAgent/work/64255532d1f9a010/server/integration/testsuite/target/server/node1/standalone/deployments
> &#27;[0m&#27;[0m18:34:39,187 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-2) ISPN000128: Infinispan version: Infinispan 'Chakra' 9.0.0-SNAPSHOT
> &#27;[0m&#27;[0m18:34:39,250 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10000: REST starting
> &#27;[0m&#27;[0m18:34:39,254 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,264 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,267 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,785 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started default cache from local container
> &#27;[0m&#27;[0m18:34:39,792 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10000: HotRodServer starting
> &#27;[0m&#27;[0m18:34:39,793 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10001: HotRodServer listening on 127.0.0.1:11222
> &#27;[0m&#27;[0m18:34:39,794 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10000: WebSocketServer starting
> &#27;[0m&#27;[0m18:34:39,795 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10001: WebSocketServer listening on 127.0.0.1:8181
> &#27;[0m&#27;[0m18:34:39,807 INFO [org.infinispan.persistence.leveldb.LevelDBStore] (MSC service thread 1-4) ISPN023006: Using pure Java LevelDB implementation: org.iq80.leveldb.impl.Iq80DBFactory
> &#27;[0m&#27;[0m18:34:39,862 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0007: Registering Deployed Cache Store service for store 'org.infinispan.persistence.cluster.MyCustomCacheStore'
> &#27;[0m&#27;[0m18:34:39,868 INFO [org.infinispan.persistence.leveldb.LevelDBStore] (MSC service thread 1-2) ISPN023005: Using JNI LevelDB implementation: org.fusesource.leveldbjni.JniDBFactory
> &#27;[0m&#27;[0m18:34:39,902 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0001: Started memcachedCache cache from local container
> &#27;[0m&#27;[0m18:34:39,903 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10000: MemcachedServer starting
> &#27;[0m&#27;[0m18:34:39,903 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10001: MemcachedServer listening on 127.0.0.1:11211
> &#27;[0m&#27;[0m18:34:39,908 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started ___protobuf_metadata cache from local container
> &#27;[0m&#27;[0m18:34:39,923 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started ___script_cache cache from local container
> &#27;[0m&#27;[0m18:34:40,166 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0001: Started namedCache cache from local container
> &#27;[0m&#27;[0m18:34:40,416 INFO [org.infinispan.rest.NettyRestServer] (MSC service thread 1-3) ISPN012003: REST server starting, listening on 127.0.0.1:8080
> &#27;[0m&#27;[0m18:34:40,416 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10002: REST mapped to /rest
> &#27;[0m&#27;[0m18:34:40,439 INFO [org.jboss.as.server] (ServerService Thread Pool -- 17) WFLYSRV0010: Deployed "custom-store.jar" (runtime-name : "custom-store.jar")
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://127.0.0.1:9990/management
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://127.0.0.1:9990
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) started in 5456ms - Started 176 of 182 services (46 services are lazy, passive or on-demand)
> &#27;[0m&#27;[0m18:34:41,888 INFO [org.jboss.as.server] (management-handler-thread - 1) WFLYSRV0211: Suspending server with 0ms timeout.
> &#27;[0m&#27;[0m18:34:41,893 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested.
> &#27;[0m&#27;[0m18:34:42,011 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-7) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]
> &#27;[0m&#27;[0m18:34:42,126 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-2) WFLYJCA0019: Stopped Driver service with driver-name = h2
> &#27;[0m&#27;[0m18:34:42,142 INFO [org.infinispan.eviction.impl.PassivationManagerImpl] (MSC service thread 1-1) ISPN000029: Passivating all entries to disk
> &#27;[0m&#27;[0m18:34:42,188 INFO [org.infinispan.eviction.impl.PassivationManagerImpl] (MSC service thread 1-1) ISPN000030: Passivated 0 entries in 45 milliseconds
> &#27;[0m&#27;[0m18:34:42,224 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-5) DGISPN0002: Stopped memcachedCache cache from local container
> &#27;[0m&#27;[0m18:34:42,226 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0002: Stopped default cache from local container
> &#27;[0m&#27;[0m18:34:42,231 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0028: Stopped deployment custom-store.jar (runtime-name: custom-store.jar) in 295ms
> &#27;[0m&#27;[0m18:34:42,258 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped namedCache cache from local container
> &#27;[0m&#27;[0m18:34:42,282 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped ___protobuf_metadata cache from local container
> &#27;[0m&#27;[0m18:34:42,308 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped ___script_cache cache from local container
> &#27;[0m&#27;[0m18:34:42,328 INFO [org.jboss.as] (MSC service thread 1-8) WFLYSRV0050: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) stopped in 392ms
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-6439) Improve stability of ExampleConfigsIT.testLevelDBCacheStoreConfig
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-6439?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-6439:
-------------------------------
Git Pull Request: (was: https://github.com/infinispan/infinispan/pull/4183)
> Improve stability of ExampleConfigsIT.testLevelDBCacheStoreConfig
> -----------------------------------------------------------------
>
> Key: ISPN-6439
> URL: https://issues.jboss.org/browse/ISPN-6439
> Project: Infinispan
> Issue Type: Bug
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
> Priority: Minor
> Labels: testsuite_stability
>
> http://ci.infinispan.org/viewLog.html?buildId=37942&tab=buildResultsDiv&b...
> {code}
> java.lang.AssertionError: expected:<v0> but was:<null>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.infinispan.server.test.configs.ExampleConfigsIT.doPutGet(ExampleConfigsIT.java:660)
> at org.infinispan.server.test.configs.ExampleConfigsIT.doPutGetCheckPath(ExampleConfigsIT.java:667)
> at org.infinispan.server.test.configs.ExampleConfigsIT.testLevelDBCacheStoreConfig(ExampleConfigsIT.java:297)
> ------- Stdout: -------
> &#27;[0m18:34:35,724 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.1.Final
> &#27;[0m&#27;[0m18:34:35,974 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> &#27;[0m&#27;[0m18:34:36,084 INFO [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) starting
> &#27;[0m&#27;[0m18:34:37,773 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
> &#27;[0m&#27;[0m18:34:37,806 INFO [org.xnio] (MSC service thread 1-5) XNIO version 3.3.4.Final
> &#27;[0m&#27;[0m18:34:37,820 INFO [org.xnio.nio] (MSC service thread 1-5) XNIO NIO Implementation Version 3.3.4.Final
> &#27;[0m&#27;[0m18:34:37,888 INFO [org.jboss.remoting] (MSC service thread 1-5) JBoss Remoting version 4.0.18.Final
> &#27;[0m&#27;[0m18:34:37,897 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 19) Activating Infinispan subsystem.
> &#27;[0m&#27;[0m18:34:37,920 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 21) WFLYIO001: Worker 'default' has auto-configured to 8 core threads with 64 task threads based on your 4 available processors
> &#27;[0m&#27;[0m18:34:37,979 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 25) WFLYNAM0001: Activating Naming Subsystem
> &#27;[0m&#27;[33m18:34:37,994 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 29) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.
> &#27;[0m&#27;[0m18:34:38,008 INFO [org.jboss.as.connector] (MSC service thread 1-3) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.2.Final)
> &#27;[0m&#27;[0m18:34:38,013 INFO [org.jboss.as.security] (ServerService Thread Pool -- 27) WFLYSEC0002: Activating Security Subsystem
> &#27;[0m&#27;[0m18:34:38,051 INFO [org.jboss.as.security] (MSC service thread 1-6) WFLYSEC0001: Current PicketBox version=4.9.4.Final
> &#27;[0m&#27;[0m18:34:38,086 INFO [org.jboss.as.naming] (MSC service thread 1-4) WFLYNAM0003: Starting Naming Service
> &#27;[0m&#27;[0m18:34:38,146 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 18) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
> &#27;[0m&#27;[0m18:34:38,163 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0018: Started Driver service with driver-name = h2
> &#27;[0m&#27;[0m18:34:38,549 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-8) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
> &#27;[0m&#27;[0m18:34:38,570 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:38,685 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0027: Starting deployment of "custom-store.jar" (runtime-name: "custom-store.jar")
> &#27;[0m&#27;[0m18:34:38,693 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-4) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/buildAgent/work/64255532d1f9a010/server/integration/testsuite/target/server/node1/standalone/deployments
> &#27;[0m&#27;[0m18:34:39,187 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-2) ISPN000128: Infinispan version: Infinispan 'Chakra' 9.0.0-SNAPSHOT
> &#27;[0m&#27;[0m18:34:39,250 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10000: REST starting
> &#27;[0m&#27;[0m18:34:39,254 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,264 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,267 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> &#27;[0m&#27;[0m18:34:39,785 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started default cache from local container
> &#27;[0m&#27;[0m18:34:39,792 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10000: HotRodServer starting
> &#27;[0m&#27;[0m18:34:39,793 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10001: HotRodServer listening on 127.0.0.1:11222
> &#27;[0m&#27;[0m18:34:39,794 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10000: WebSocketServer starting
> &#27;[0m&#27;[0m18:34:39,795 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10001: WebSocketServer listening on 127.0.0.1:8181
> &#27;[0m&#27;[0m18:34:39,807 INFO [org.infinispan.persistence.leveldb.LevelDBStore] (MSC service thread 1-4) ISPN023006: Using pure Java LevelDB implementation: org.iq80.leveldb.impl.Iq80DBFactory
> &#27;[0m&#27;[0m18:34:39,862 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0007: Registering Deployed Cache Store service for store 'org.infinispan.persistence.cluster.MyCustomCacheStore'
> &#27;[0m&#27;[0m18:34:39,868 INFO [org.infinispan.persistence.leveldb.LevelDBStore] (MSC service thread 1-2) ISPN023005: Using JNI LevelDB implementation: org.fusesource.leveldbjni.JniDBFactory
> &#27;[0m&#27;[0m18:34:39,902 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0001: Started memcachedCache cache from local container
> &#27;[0m&#27;[0m18:34:39,903 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10000: MemcachedServer starting
> &#27;[0m&#27;[0m18:34:39,903 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10001: MemcachedServer listening on 127.0.0.1:11211
> &#27;[0m&#27;[0m18:34:39,908 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started ___protobuf_metadata cache from local container
> &#27;[0m&#27;[0m18:34:39,923 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started ___script_cache cache from local container
> &#27;[0m&#27;[0m18:34:40,166 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0001: Started namedCache cache from local container
> &#27;[0m&#27;[0m18:34:40,416 INFO [org.infinispan.rest.NettyRestServer] (MSC service thread 1-3) ISPN012003: REST server starting, listening on 127.0.0.1:8080
> &#27;[0m&#27;[0m18:34:40,416 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10002: REST mapped to /rest
> &#27;[0m&#27;[0m18:34:40,439 INFO [org.jboss.as.server] (ServerService Thread Pool -- 17) WFLYSRV0010: Deployed "custom-store.jar" (runtime-name : "custom-store.jar")
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://127.0.0.1:9990/management
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://127.0.0.1:9990
> &#27;[0m&#27;[0m18:34:40,522 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) started in 5456ms - Started 176 of 182 services (46 services are lazy, passive or on-demand)
> &#27;[0m&#27;[0m18:34:41,888 INFO [org.jboss.as.server] (management-handler-thread - 1) WFLYSRV0211: Suspending server with 0ms timeout.
> &#27;[0m&#27;[0m18:34:41,893 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested.
> &#27;[0m&#27;[0m18:34:42,011 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-7) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]
> &#27;[0m&#27;[0m18:34:42,126 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-2) WFLYJCA0019: Stopped Driver service with driver-name = h2
> &#27;[0m&#27;[0m18:34:42,142 INFO [org.infinispan.eviction.impl.PassivationManagerImpl] (MSC service thread 1-1) ISPN000029: Passivating all entries to disk
> &#27;[0m&#27;[0m18:34:42,188 INFO [org.infinispan.eviction.impl.PassivationManagerImpl] (MSC service thread 1-1) ISPN000030: Passivated 0 entries in 45 milliseconds
> &#27;[0m&#27;[0m18:34:42,224 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-5) DGISPN0002: Stopped memcachedCache cache from local container
> &#27;[0m&#27;[0m18:34:42,226 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0002: Stopped default cache from local container
> &#27;[0m&#27;[0m18:34:42,231 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0028: Stopped deployment custom-store.jar (runtime-name: custom-store.jar) in 295ms
> &#27;[0m&#27;[0m18:34:42,258 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped namedCache cache from local container
> &#27;[0m&#27;[0m18:34:42,282 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped ___protobuf_metadata cache from local container
> &#27;[0m&#27;[0m18:34:42,308 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0002: Stopped ___script_cache cache from local container
> &#27;[0m&#27;[0m18:34:42,328 INFO [org.jboss.as] (MSC service thread 1-8) WFLYSRV0050: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.0.10.Final) stopped in 392ms
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-7163) InfinispanNodeFailureTest.killedNodeDoesNotBreakReplaceCommand random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7163?page=com.atlassian.jira.plugin.... ]
Dan Berindei closed ISPN-7163.
------------------------------
Fix Version/s: (was: 9.0.0.Beta1)
Resolution: Duplicate Issue
> InfinispanNodeFailureTest.killedNodeDoesNotBreakReplaceCommand random failures
> ------------------------------------------------------------------------------
>
> Key: ISPN-7163
> URL: https://issues.jboss.org/browse/ISPN-7163
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Reporter: Dan Berindei
> Priority: Critical
> Labels: testsuite_stability
> Attachments: InfinispanNodeFailureTest_20161021.log
>
>
> {noformat}
> 00:07:56,440 ERROR (testng-InfinispanNodeFailureTest:[]) [TestSuiteProgress] Test failed: org.infinispan.tx.InfinispanNodeFailureTest.killedNodeDoesNotBreakReplaceCommand
> java.lang.AssertionError: expected:<false> but was:<true>
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59) ~[testng-6.8.8.jar:?]
> at org.testng.AssertJUnit.failNotEquals(AssertJUnit.java:364) ~[testng-6.8.8.jar:?]
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:80) ~[testng-6.8.8.jar:?]
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:185) ~[testng-6.8.8.jar:?]
> at org.testng.AssertJUnit.assertEquals(AssertJUnit.java:192) ~[testng-6.8.8.jar:?]
> at org.infinispan.tx.InfinispanNodeFailureTest.killedNodeDoesNotBreakReplaceCommand(InfinispanNodeFailureTest.java:135) ~[test-classes/:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-7070) CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7070?page=com.atlassian.jira.plugin.... ]
Dan Berindei edited comment on ISPN-7070 at 11/3/16 8:51 AM:
-------------------------------------------------------------
{{onAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered}} can also fail with the same error:
{noformat}
00:06:41,609 ERROR (testng-CacheNotifierImplInitialTransferDistTest:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
java.lang.AssertionError: expected [12] but found [11]
at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?]
at org.testng.Assert.failNotEquals(Assert.java:494) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:123) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:370) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:380) ~[testng-6.8.8.jar:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete(CacheNotifierImplInitialTransferDistTest.java:509) ~[test-classes/:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered(CacheNotifierImplInitialTransferDistTest.java:622) ~[test-classes/:?]
{noformat}
was (Author: dan.berindei):
{{testPrimaryOwnerGoesDownBeforeSendingEvent}} can also fail with the same error:
{noformat}
00:06:41,609 ERROR (testng-CacheNotifierImplInitialTransferDistTest:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
java.lang.AssertionError: expected [12] but found [11]
at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?]
at org.testng.Assert.failNotEquals(Assert.java:494) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:123) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:370) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:380) ~[testng-6.8.8.jar:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete(CacheNotifierImplInitialTransferDistTest.java:509) ~[test-classes/:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered(CacheNotifierImplInitialTransferDistTest.java:622) ~[test-classes/:?]
{noformat}
> CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete random failures
> ------------------------------------------------------------------------------------------------
>
> Key: ISPN-7070
> URL: https://issues.jboss.org/browse/ISPN-7070
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 9.0.0.Alpha4
> Reporter: Dan Berindei
> Assignee: William Burns
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.0.0.Beta1
>
> Attachments: CacheNotifierImplInitialTransferDistTest_ISPN-5467_CompletableFuture-like_API_20161003.log
>
>
> Looks like sometimes the originator listener ignores the CACHE_ENTRY_REMOVED notification:
> {noformat}
> 09:58:57,877 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
> 09:58:58,913 DEBUG (testng-Test:[]) [Test] Found key key-to-change-0 with primary owner != Test-NodeA-7051, segment 60
> 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null})
> 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null})
> 09:58:59,014 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@68007f8
> 09:58:59,014 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:58,998 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1
> 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,145 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 requests initial state for cache
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233, 60]
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false}
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-0
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1)
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1
> 09:58:59,373 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1)
> 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91126] on Test-NodeA-7051
> 09:58:59,684 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91126
> 09:58:59,779 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@640b0234]
> 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeC-52778}], notifying cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,837 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999)
> 09:58:59,837 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999)
> 09:58:59,898 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 initial state for cache completed
> 09:58:59,916 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,943 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
> java.lang.AssertionError: expected [12] but found [11]
> {noformat}
> {{CacheNotifierImplInitialTransferDistTest}} also had a different problem: it replaced the {{CacheNotifier}} component with a clone before adding the listener, but replaced it again with the original before removing the listener. Because the listener's uuid was only registered in the clone, {{removeListener}} couldn't find the uuid and disn't try to remove the listener on the other nodes. This meant the listener was leaked, resulting in logs like this:
> {noformat}
> 20:12:04,098 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 20:12:04,099 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,106 TRACE (remote-thread-Test-NodeA-p24103-t6:[]) [MultiClusterEventCallable] Received multiple cluster event(s) {86f77630-b1bb-4a21-97bb-b03efeae39d6=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], 91d05a50-4a35-4e37-8c5c-bffbabc6154b=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], ba09480f-c698-431b-8fe6-213f1bdefc7b=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], 992da014-0516-4f2a-8093-50ba3b1f358a=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], b4eeb9b3-85c4-4ff9-865e-076b7cf93faa=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}]}
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-7166) WriteSkewConsistencyTest.testValidationOnlyInPrimaryOwner[DIST_SYNC] random failures
by Dan Berindei (JIRA)
Dan Berindei created ISPN-7166:
----------------------------------
Summary: WriteSkewConsistencyTest.testValidationOnlyInPrimaryOwner[DIST_SYNC] random failures
Key: ISPN-7166
URL: https://issues.jboss.org/browse/ISPN-7166
Project: Infinispan
Issue Type: Bug
Components: Test Suite - Core
Affects Versions: 9.0.0.Alpha4
Reporter: Dan Berindei
Assignee: Dan Berindei
Fix For: 9.0.0.Beta1
The test requires a key to have a specific primary owner and backup owner, but because is uses the default {{SynchronizedConsistentHashFactory}}, sometimes there's no segment meeting that requirement.
{noformat}
16:52:02,516 ERROR (testng-WriteSkewConsistencyTest[DIST_SYNC]:[]) [TestSuiteProgress] Test failed: org.infinispan.container.versioning.WriteSkewConsistencyTest.testValidationOnlyInPrimaryOwner[DIST_SYNC]
java.lang.IllegalStateException: Could not find any segment owned by Cache '___defaultcache'@WriteSkewConsistencyTest[DIST_SYNC]-NodeB-47455, [Cache '___defaultcache'@WriteSkewConsistencyTest[DIST_SYNC]-NodeA-21455], primary segments: [33, 2, 3, 5, 37, 6, 41, 10, 45, 15, 48, 18, 50, 25, 59, 29], backup segments: {Cache '___defaultcache'@WriteSkewConsistencyTest[DIST_SYNC]-NodeA-21455=[35, 8, 40, 12, 14, 52, 21, 53, 22, 24, 57, 58, 27, 31]}
at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:85) ~[test-classes/:?]
at org.infinispan.distribution.MagicKey.<init>(MagicKey.java:136) ~[test-classes/:?]
at org.infinispan.container.versioning.WriteSkewConsistencyTest.testValidationOnlyInPrimaryOwner(WriteSkewConsistencyTest.java:58) ~[test-classes/:?]
{noformat}
The test should either use a fixed key and accept random owners, or use a {{ControlledConsistentHashFactory}} to pin the owners.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-7070) CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-7070?page=com.atlassian.jira.plugin.... ]
Dan Berindei commented on ISPN-7070:
------------------------------------
{{testPrimaryOwnerGoesDownBeforeSendingEvent}} can also fail with the same error:
{noformat}
00:06:41,609 ERROR (testng-CacheNotifierImplInitialTransferDistTest:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
java.lang.AssertionError: expected [12] but found [11]
at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?]
at org.testng.Assert.failNotEquals(Assert.java:494) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:123) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:370) ~[testng-6.8.8.jar:?]
at org.testng.Assert.assertEquals(Assert.java:380) ~[testng-6.8.8.jar:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete(CacheNotifierImplInitialTransferDistTest.java:509) ~[test-classes/:?]
at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered(CacheNotifierImplInitialTransferDistTest.java:622) ~[test-classes/:?]
{noformat}
> CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete random failures
> ------------------------------------------------------------------------------------------------
>
> Key: ISPN-7070
> URL: https://issues.jboss.org/browse/ISPN-7070
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 9.0.0.Alpha4
> Reporter: Dan Berindei
> Assignee: William Burns
> Priority: Critical
> Labels: testsuite_stability
> Fix For: 9.0.0.Beta1
>
> Attachments: CacheNotifierImplInitialTransferDistTest_ISPN-5467_CompletableFuture-like_API_20161003.log
>
>
> Looks like sometimes the originator listener ignores the CACHE_ENTRY_REMOVED notification:
> {noformat}
> 09:58:57,877 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
> 09:58:58,913 DEBUG (testng-Test:[]) [Test] Found key key-to-change-0 with primary owner != Test-NodeA-7051, segment 60
> 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null})
> 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null})
> 09:58:59,014 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@68007f8
> 09:58:59,014 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:58,998 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1
> 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,145 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 requests initial state for cache
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233, 60]
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false}
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-0
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1)
> 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1
> 09:58:59,373 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1)
> 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91126] on Test-NodeA-7051
> 09:58:59,684 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91126
> 09:58:59,779 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@640b0234]
> 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeC-52778}], notifying cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,837 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999)
> 09:58:59,837 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999)
> 09:58:59,898 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 initial state for cache completed
> 09:58:59,916 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1
> 09:58:59,943 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered
> java.lang.AssertionError: expected [12] but found [11]
> {noformat}
> {{CacheNotifierImplInitialTransferDistTest}} also had a different problem: it replaced the {{CacheNotifier}} component with a clone before adding the listener, but replaced it again with the original before removing the listener. Because the listener's uuid was only registered in the clone, {{removeListener}} couldn't find the uuid and disn't try to remove the listener on the other nodes. This meant the listener was leaked, resulting in logs like this:
> {noformat}
> 20:12:04,098 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null)
> 20:12:04,099 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,100 TRACE (remote-thread-Test-NodeB-p24127-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-56142, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-38047
> 20:12:04,106 TRACE (remote-thread-Test-NodeA-p24103-t6:[]) [MultiClusterEventCallable] Received multiple cluster event(s) {86f77630-b1bb-4a21-97bb-b03efeae39d6=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], 91d05a50-4a35-4e37-8c5c-bffbabc6154b=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], ba09480f-c698-431b-8fe6-213f1bdefc7b=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], 992da014-0516-4f2a-8093-50ba3b1f358a=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}], b4eeb9b3-85c4-4ff9-865e-076b7cf93faa=[ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-38047, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-56142}]}
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months
[JBoss JIRA] (ISPN-5021) Nodes that finish the rebalance later can see outdated values
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-5021?page=com.atlassian.jira.plugin.... ]
Radim Vansa updated ISPN-5021:
------------------------------
Description:
Copied from [ISPN-4444|https://issues.jboss.org/browse/ISPN-4444?focusedCommentId=1302...]
If the CH_UPDATE command is delayed on the old owner, the new owners might update the key without the old owner knowing, and a locality check on the old owner won't help.
I remember one thing that struck me when reading the Raft algorithm was that they install configuration changes symmetrically, in 3 phases. We might need to do the same for our rebalance:
1. T0: read_ch=old, write_ch=old
2. start a rebalance
3. T1: read_ch=old, write_ch=old+new
4. new owners have all the data
5. T2: read_ch=new, write_ch=old+new
6. remove old cache entries and ignore further writes
7. T3: read_ch=new, write_ch=new
was:
Copied from [ISPN-4444|https://issues.jboss.org/browse/ISPN-4444?focusedCommentId=1302...]
If the CH_UPDATE command is delayed on the old owner, the new owners might update the key without the old owner knowing, and a locality check on the old owner won't help.
I remember one thing that struck me when reading the Raft algorithm was that they install configuration changes symmetrically, in 3 phases. We might need to do the same for our rebalance: start a rebalance with read_ch=old, write_ch=old+new, when the new owners have all the data install read_ch=new, write_ch=old+new, and finally read_ch=new, write_ch=new. Old cache entries are removed during the 2nd topology update, and further writes should be ignored, in order for this to work.
> Nodes that finish the rebalance later can see outdated values
> -------------------------------------------------------------
>
> Key: ISPN-5021
> URL: https://issues.jboss.org/browse/ISPN-5021
> Project: Infinispan
> Issue Type: Bug
> Components: Core, State Transfer
> Affects Versions: 7.0.2.Final
> Reporter: Dan Berindei
> Assignee: Pedro Ruivo
> Priority: Critical
>
> Copied from [ISPN-4444|https://issues.jboss.org/browse/ISPN-4444?focusedCommentId=1302...]
> If the CH_UPDATE command is delayed on the old owner, the new owners might update the key without the old owner knowing, and a locality check on the old owner won't help.
> I remember one thing that struck me when reading the Raft algorithm was that they install configuration changes symmetrically, in 3 phases. We might need to do the same for our rebalance:
> 1. T0: read_ch=old, write_ch=old
> 2. start a rebalance
> 3. T1: read_ch=old, write_ch=old+new
> 4. new owners have all the data
> 5. T2: read_ch=new, write_ch=old+new
> 6. remove old cache entries and ignore further writes
> 7. T3: read_ch=new, write_ch=new
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 2 months