[JBoss JIRA] (ISPN-7487) Fix NPE in ClusterCacheStatus.java:147
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7487?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec commented on ISPN-7487:
-------------------------------------------
It looks like the problem is with this statement:
{code}
if (modeChanged || !actualMembers.equals(currentTopology.getActualMembers())) {
{code}
{{modeChanged}} can not be null, it's a boolean. So there are two suspects: {{actualMembers}} and {{currentTopology}}.
{{actualMembers}} seems unlikely because it's passed all the way down from [this statement|https://github.com/infinispan/infinispan/blob/master/core/src/m...]:
{code}
List<Address> actualMembers = new ArrayList<>(context.getExpectedMembers());
{code}
That means {{currentTopology}} must be {{null}}.
> Fix NPE in ClusterCacheStatus.java:147
> --------------------------------------
>
> Key: ISPN-7487
> URL: https://issues.jboss.org/browse/ISPN-7487
> Project: Infinispan
> Issue Type: Bug
> Components: Cloud Integrations, Core
> Affects Versions: 9.0.0.CR1
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Custom Infinispan Server build (based on [these instructions|https://github.com/slaskawi/infinispan-1/tree/custom_image]). SHA1 {{2b0731b21649a88a75ed71d21b9cc06ba365e947}}
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
> Priority: Blocker
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> kubetail -l environment=infrastructure
> Will tail 3 logs...
> transactions-repository-1-04x09
> transactions-repository-1-1f8dx
> transactions-repository-1-4z05w
> [transactions-repository-1-1f8dx] JAVA_OPTS already set in environment; overriding default settings with values: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-1f8dx] =========================================================================
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] JBoss Bootstrap Environment
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] JBOSS_HOME: /opt/jboss/infinispan-server
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] JAVA: /usr/lib/jvm/java/bin/java
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] JAVA_OPTS: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] =========================================================================
> [transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] 17:54:15,634 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
> [transactions-repository-1-1f8dx] 17:54:15,853 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> [transactions-repository-1-1f8dx] 17:54:15,931 INFO [org.jboss.as] (MSC service thread 1-8) WFLYSRV0049: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) starting
> [transactions-repository-1-1f8dx] 17:54:17,232 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 7) WFLYCTL0028: Attribute 'default-stack' in the resource at address '/subsystem=datagrid-jgroups' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation.
> [transactions-repository-1-1f8dx] [GC (CMS Initial Mark) 234913K(1013632K), 0.0473268 secs]
> [transactions-repository-1-1f8dx] 17:54:17,432 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
> [transactions-repository-1-1f8dx] 17:54:17,452 INFO [org.xnio] (MSC service thread 1-2) XNIO version 3.4.0.Final
> [transactions-repository-1-1f8dx] 17:54:17,464 INFO [org.xnio.nio] (MSC service thread 1-2) XNIO NIO Implementation Version 3.4.0.Final
> [transactions-repository-1-1f8dx] 17:54:17,516 INFO [org.jboss.remoting] (MSC service thread 1-3) JBoss Remoting version 4.0.21.Final
> [transactions-repository-1-1f8dx] 17:54:17,553 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 19) Activating Infinispan subsystem.
> [transactions-repository-1-1f8dx] [GC (GCLocker Initiated GC) 279722K->29726K(1013632K), 0.0377206 secs]
> [transactions-repository-1-1f8dx] 17:54:17,611 INFO [org.infinispan.server.jgroups] (ServerService Thread Pool -- 21) DGJGRP0001: Activating JGroups subsystem.
> [transactions-repository-1-1f8dx] 17:54:17,630 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 29) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.
> [transactions-repository-1-1f8dx] 17:54:17,646 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 26) WFLYNAM0001: Activating Naming Subsystem
> [transactions-repository-1-1f8dx] 17:54:17,646 INFO [org.jboss.as.security] (ServerService Thread Pool -- 28) WFLYSEC0002: Activating Security Subsystem
> [transactions-repository-1-1f8dx] 17:54:17,652 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 22) WFLYIO001: Worker 'default' has auto-configured to 16 core threads with 128 task threads based on your 8 available processors
> [transactions-repository-1-1f8dx] 17:54:17,653 INFO [org.jboss.as.security] (MSC service thread 1-8) WFLYSEC0001: Current PicketBox version=4.9.6.Final
> [transactions-repository-1-1f8dx] 17:54:17,673 INFO [org.jboss.as.connector] (MSC service thread 1-4) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.4.Final)
> [transactions-repository-1-1f8dx] 17:54:17,701 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 18) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
> [transactions-repository-1-1f8dx] 17:54:17,703 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-6) WFLYJCA0018: Started Driver service with driver-name = h2
> [transactions-repository-1-1f8dx] 17:54:17,744 INFO [org.jboss.as.naming] (MSC service thread 1-7) WFLYNAM0003: Starting Naming Service
> [transactions-repository-1-1f8dx] 17:54:18,268 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-1-1f8dx] 17:54:18,425 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-1f8dx] 17:54:18,429 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-1f8dx] 17:54:18,779 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-5) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/jboss/infinispan-server/standalone/deployments
> [transactions-repository-1-04x09] JAVA_OPTS already set in environment; overriding default settings with values: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-04x09] =========================================================================
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] JBoss Bootstrap Environment
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] JBOSS_HOME: /opt/jboss/infinispan-server
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] JAVA: /usr/lib/jvm/java/bin/java
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] JAVA_OPTS: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] =========================================================================
> [transactions-repository-1-04x09]
> [transactions-repository-1-04x09] 17:54:15,628 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
> [transactions-repository-1-04x09] 17:54:15,849 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> [transactions-repository-1-04x09] 17:54:15,960 INFO [org.jboss.as] (MSC service thread 1-5) WFLYSRV0049: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) starting
> [transactions-repository-1-04x09] [GC (CMS Initial Mark) 218119K(1013632K), 0.0624692 secs]
> [transactions-repository-1-04x09] 17:54:17,475 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 13) WFLYCTL0028: Attribute 'default-stack' in the resource at address '/subsystem=datagrid-jgroups' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation.
> [transactions-repository-1-04x09] 17:54:17,647 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
> [transactions-repository-1-04x09] 17:54:17,664 INFO [org.xnio] (MSC service thread 1-3) XNIO version 3.4.0.Final
> [transactions-repository-1-04x09] 17:54:17,683 INFO [org.xnio.nio] (MSC service thread 1-3) XNIO NIO Implementation Version 3.4.0.Final
> [transactions-repository-1-04x09] 17:54:17,763 INFO [org.jboss.remoting] (MSC service thread 1-4) JBoss Remoting version 4.0.21.Final
> [transactions-repository-1-04x09] [GC (Allocation Failure) 279616K->29652K(1013632K), 0.0690895 secs]
> [transactions-repository-1-04x09] 17:54:17,872 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 19) Activating Infinispan subsystem.
> [transactions-repository-1-04x09] 17:54:17,875 INFO [org.infinispan.server.jgroups] (ServerService Thread Pool -- 21) DGJGRP0001: Activating JGroups subsystem.
> [transactions-repository-1-04x09] [GC (CMS Final Remark) 68259K(1013632K), 0.0485831 secs]
> [transactions-repository-1-04x09] 17:54:17,933 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 22) WFLYIO001: Worker 'default' has auto-configured to 16 core threads with 128 task threads based on your 8 available processors
> [transactions-repository-1-04x09] 17:54:17,960 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 29) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.
> [transactions-repository-1-04x09] 17:54:17,972 INFO [org.jboss.as.security] (ServerService Thread Pool -- 28) WFLYSEC0002: Activating Security Subsystem
> [transactions-repository-1-04x09] 17:54:17,972 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 26) WFLYNAM0001: Activating Naming Subsystem
> [transactions-repository-1-04x09] 17:54:17,984 INFO [org.jboss.as.security] (MSC service thread 1-4) WFLYSEC0001: Current PicketBox version=4.9.6.Final
> [transactions-repository-1-04x09] 17:54:18,004 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 18) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
> [transactions-repository-1-04x09] 17:54:18,027 INFO [org.jboss.as.naming] (MSC service thread 1-5) WFLYNAM0003: Starting Naming Service
> [transactions-repository-1-04x09] 17:54:18,053 INFO [org.jboss.as.connector] (MSC service thread 1-8) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.4.Final)
> [transactions-repository-1-04x09] 17:54:18,065 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-6) WFLYJCA0018: Started Driver service with driver-name = h2
> [transactions-repository-1-04x09] 17:54:18,543 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-04x09] 17:54:18,561 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-04x09] 17:54:18,584 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-6) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-1-04x09] 17:54:18,795 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-2) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/jboss/infinispan-server/standalone/deployments
> [transactions-repository-1-4z05w] JAVA_OPTS already set in environment; overriding default settings with values: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-4z05w] =========================================================================
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] JBoss Bootstrap Environment
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] JBOSS_HOME: /opt/jboss/infinispan-server
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] JAVA: /usr/lib/jvm/java/bin/java
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] JAVA_OPTS: -server -Xms1G -Xmx1G -XX:+UseConcMarkSweepGC -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -XX:+PrintGC
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] =========================================================================
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] 17:54:15,714 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
> [transactions-repository-1-4z05w] 17:54:15,950 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> [transactions-repository-1-4z05w] 17:54:16,016 INFO [org.jboss.as] (MSC service thread 1-6) WFLYSRV0049: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) starting
> [transactions-repository-1-4z05w] 17:54:17,364 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 5) WFLYCTL0028: Attribute 'default-stack' in the resource at address '/subsystem=datagrid-jgroups' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation.
> [transactions-repository-1-4z05w] [GC (CMS Initial Mark) 234897K(1013632K), 0.0587177 secs]
> [transactions-repository-1-4z05w] 17:54:17,599 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
> [transactions-repository-1-4z05w] 17:54:17,620 INFO [org.xnio] (MSC service thread 1-5) XNIO version 3.4.0.Final
> [transactions-repository-1-4z05w] 17:54:17,626 INFO [org.xnio.nio] (MSC service thread 1-5) XNIO NIO Implementation Version 3.4.0.Final
> [transactions-repository-1-4z05w] 17:54:17,674 INFO [org.jboss.remoting] (MSC service thread 1-5) JBoss Remoting version 4.0.21.Final
> [transactions-repository-1-4z05w] [GC (Allocation Failure) 279616K->29736K(1013632K), 0.0733498 secs]
> [transactions-repository-1-4z05w] 17:54:17,799 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 19) Activating Infinispan subsystem.
> [transactions-repository-1-4z05w] 17:54:17,802 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 29) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.
> [transactions-repository-1-4z05w] 17:54:17,829 INFO [org.jboss.as.security] (ServerService Thread Pool -- 28) WFLYSEC0002: Activating Security Subsystem
> [transactions-repository-1-4z05w] 17:54:17,831 INFO [org.infinispan.server.jgroups] (ServerService Thread Pool -- 21) DGJGRP0001: Activating JGroups subsystem.
> [transactions-repository-1-4z05w] 17:54:17,835 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 22) WFLYIO001: Worker 'default' has auto-configured to 16 core threads with 128 task threads based on your 8 available processors
> [transactions-repository-1-4z05w] 17:54:17,870 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 26) WFLYNAM0001: Activating Naming Subsystem
> [transactions-repository-1-4z05w] 17:54:17,881 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 18) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
> [transactions-repository-1-4z05w] 17:54:17,887 INFO [org.jboss.as.connector] (MSC service thread 1-2) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.4.Final)
> [transactions-repository-1-4z05w] 17:54:17,895 INFO [org.jboss.as.security] (MSC service thread 1-4) WFLYSEC0001: Current PicketBox version=4.9.6.Final
> [transactions-repository-1-4z05w] 17:54:17,900 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0018: Started Driver service with driver-name = h2
> [transactions-repository-1-4z05w] 17:54:18,037 INFO [org.jboss.as.naming] (MSC service thread 1-6) WFLYNAM0003: Starting Naming Service
> [transactions-repository-1-4z05w] 17:54:18,842 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-1-4z05w] 17:54:18,920 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-4z05w] 17:54:18,934 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 19) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-4z05w] 17:54:19,094 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-6) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/jboss/infinispan-server/standalone/deployments
> [transactions-repository-1-4z05w] 17:54:20,553 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-6) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-4z05w] 17:54:20,555 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-6) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-4z05w] [GC (CMS Final Remark) 171687K(1013632K), 0.0585468 secs]
> [transactions-repository-1-4z05w] 17:54:20,716 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-6) ISPN000078: Starting JGroups channel clustered
> [transactions-repository-1-4z05w] 17:54:20,732 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-6) ISPN000094: Received new cluster view for channel clustered: [transactions-repository-1-4z05w|2] (3) [transactions-repository-1-4z05w, transactions-repository-1-04x09, transactions-repository-1-1f8dx]
> [transactions-repository-1-4z05w] 17:54:20,742 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-6) ISPN000079: Channel clustered local address is transactions-repository-1-4z05w, physical addresses are [172.17.0.3:7600]
> [transactions-repository-1-4z05w] 17:54:20,754 INFO [org.infinispan.globalstate.impl.GlobalStateManagerImpl] (MSC service thread 1-6) ISPN000390: Persisted state, version=9.0.0-SNAPSHOT timestamp=2017-02-18T17:54:20.748Z
> [transactions-repository-1-4z05w] 17:54:20,755 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-6) ISPN000128: Infinispan version: Infinispan 'Ruppaner' 9.0.0-SNAPSHOT
> [transactions-repository-1-4z05w] 17:54:20,933 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-6) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-4z05w] 17:54:20,933 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-6) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-4z05w] 17:54:20,936 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-5) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-4z05w] 17:54:20,939 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-4z05w] 17:54:20,943 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-4z05w] 17:54:20,954 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-4) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-4z05w] 17:54:20,950 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-5) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-4z05w] 17:54:20,956 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-5) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-1f8dx] [GC (CMS Final Remark) 172593K(1013632K), 0.0447491 secs]
> [transactions-repository-1-04x09] 17:54:20,995 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-3) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-04x09] 17:54:20,996 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-3) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-04x09] 17:54:21,109 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000078: Starting JGroups channel clustered
> [transactions-repository-1-04x09] 17:54:21,129 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000094: Received new cluster view for channel clustered: [transactions-repository-1-4z05w|2] (3) [transactions-repository-1-4z05w, transactions-repository-1-04x09, transactions-repository-1-1f8dx]
> [transactions-repository-1-04x09] 17:54:21,138 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000079: Channel clustered local address is transactions-repository-1-04x09, physical addresses are [172.17.0.4:7600]
> [transactions-repository-1-1f8dx] 17:54:21,158 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-8) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-1f8dx] 17:54:21,158 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-8) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-04x09] 17:54:21,160 INFO [org.infinispan.globalstate.impl.GlobalStateManagerImpl] (MSC service thread 1-3) ISPN000390: Persisted state, version=9.0.0-SNAPSHOT timestamp=2017-02-18T17:54:21.156Z
> [transactions-repository-1-04x09] 17:54:21,160 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-3) ISPN000128: Infinispan version: Infinispan 'Ruppaner' 9.0.0-SNAPSHOT
> [transactions-repository-1-1f8dx] 17:54:21,254 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000078: Starting JGroups channel clustered
> [transactions-repository-1-1f8dx] 17:54:21,266 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000094: Received new cluster view for channel clustered: [transactions-repository-1-4z05w|2] (3) [transactions-repository-1-4z05w, transactions-repository-1-04x09, transactions-repository-1-1f8dx]
> [transactions-repository-1-1f8dx] 17:54:21,269 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000079: Channel clustered local address is transactions-repository-1-1f8dx, physical addresses are [172.17.0.6:7600]
> [transactions-repository-1-1f8dx] 17:54:21,282 INFO [org.infinispan.globalstate.impl.GlobalStateManagerImpl] (MSC service thread 1-8) ISPN000390: Persisted state, version=9.0.0-SNAPSHOT timestamp=2017-02-18T17:54:21.279Z
> [transactions-repository-1-1f8dx] 17:54:21,283 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-8) ISPN000128: Infinispan version: Infinispan 'Ruppaner' 9.0.0-SNAPSHOT
> [transactions-repository-1-04x09] 17:54:21,297 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-3) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-04x09] 17:54:21,297 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-3) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-04x09] 17:54:21,300 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-6) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-04x09] 17:54:21,303 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-2) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-04x09] 17:54:21,305 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-6) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-04x09] 17:54:21,310 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-6) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-04x09] 17:54:21,310 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-2) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-04x09] 17:54:21,311 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-2) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-1f8dx] 17:54:21,443 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-8) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-1f8dx] 17:54:21,443 WARN [org.infinispan.configuration.cache.AbstractStoreConfigurationBuilder] (MSC service thread 1-8) ISPN000149: Fetch persistent state and purge on startup are both disabled, cache may contain stale entries on startup
> [transactions-repository-1-1f8dx] 17:54:21,449 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-8) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-1f8dx] 17:54:21,450 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-8) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-1f8dx] 17:54:21,452 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-4) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-1f8dx] 17:54:21,462 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-4) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-1f8dx] 17:54:21,462 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (MSC service thread 1-8) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.
> [transactions-repository-1-1f8dx] 17:54:21,468 WARN [org.infinispan.configuration.cache.IndexingConfigurationBuilder] (MSC service thread 1-4) ISPN000403: No indexable classes were defined for this indexed cache; switching to autodetection (support for autodetection will be removed in Infinispan 9.0).
> [transactions-repository-1-04x09] [GC (CMS Initial Mark) 208341K(1013632K), 0.0101475 secs]
> [transactions-repository-1-4z05w] 17:54:23,974 ERROR [org.infinispan.topology.ClusterCacheStatus] (transport-thread--p4-t9) ISPN000228: Failed to recover cache transactions state after the current node became the coordinator: java.lang.NullPointerException
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterCacheStatus.updateAvailabilityMode(ClusterCacheStatus.java:147)
> [transactions-repository-1-4z05w] at org.infinispan.partitionhandling.impl.PreferConsistencyStrategy.updateMembersAndRebalance(PreferConsistencyStrategy.java:259)
> [transactions-repository-1-4z05w] at org.infinispan.partitionhandling.impl.PreferConsistencyStrategy.onPartitionMerge(PreferConsistencyStrategy.java:210)
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterCacheStatus.doMergePartitions(ClusterCacheStatus.java:554)
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterTopologyManagerImpl.lambda$recoverClusterStatus$3(ClusterTopologyManagerImpl.java:499)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor.runTasks(LimitedExecutor.java:144)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor.access$100(LimitedExecutor.java:33)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor$Runner.run(LimitedExecutor.java:174)
> [transactions-repository-1-4z05w] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [transactions-repository-1-4z05w] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [transactions-repository-1-4z05w] at java.lang.Thread.run(Thread.java:745)
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] 17:54:23,974 ERROR [org.infinispan.topology.ClusterCacheStatus] (transport-thread--p4-t7) ISPN000228: Failed to recover cache sessions state after the current node became the coordinator: java.lang.NullPointerException
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterCacheStatus.updateAvailabilityMode(ClusterCacheStatus.java:147)
> [transactions-repository-1-4z05w] at org.infinispan.partitionhandling.impl.PreferConsistencyStrategy.updateMembersAndRebalance(PreferConsistencyStrategy.java:259)
> [transactions-repository-1-4z05w] at org.infinispan.partitionhandling.impl.PreferConsistencyStrategy.onPartitionMerge(PreferConsistencyStrategy.java:210)
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterCacheStatus.doMergePartitions(ClusterCacheStatus.java:554)
> [transactions-repository-1-4z05w] at org.infinispan.topology.ClusterTopologyManagerImpl.lambda$recoverClusterStatus$3(ClusterTopologyManagerImpl.java:499)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor.runTasks(LimitedExecutor.java:144)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor.access$100(LimitedExecutor.java:33)
> [transactions-repository-1-4z05w] at org.infinispan.executors.LimitedExecutor$Runner.run(LimitedExecutor.java:174)
> [transactions-repository-1-4z05w] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [transactions-repository-1-4z05w] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [transactions-repository-1-4z05w] at java.lang.Thread.run(Thread.java:745)
> [transactions-repository-1-4z05w]
> [transactions-repository-1-4z05w] 17:54:24,005 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-8) DGISPN0001: Started transactions cache from clustered container
> [transactions-repository-1-4z05w] 17:54:24,005 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0001: Started default cache from clustered container
> [transactions-repository-1-04x09] 17:54:24,005 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0001: Started default cache from clustered container
> [transactions-repository-1-04x09] 17:54:24,006 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0001: Started memcachedCache cache from clustered container
> [transactions-repository-1-04x09] 17:54:24,006 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-1) DGISPN0001: Started transactions cache from clustered container
> [transactions-repository-1-4z05w] 17:54:24,008 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0001: Started memcachedCache cache from clustered container
> [transactions-repository-1-4z05w] 17:54:24,010 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-6) DGISPN0001: Started sessions cache from clustered container
> [transactions-repository-1-04x09] 17:54:24,011 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0001: Started sessions cache from clustered container
> [transactions-repository-1-1f8dx] 17:54:24,012 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-5) DGISPN0001: Started sessions cache from clustered container
> [transactions-repository-1-1f8dx] 17:54:24,012 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-6) DGISPN0001: Started memcachedCache cache from clustered container
> [transactions-repository-1-1f8dx] 17:54:24,012 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0001: Started default cache from clustered container
> [transactions-repository-1-1f8dx] 17:54:24,013 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0001: Started transactions cache from clustered container
> [transactions-repository-1-4z05w] 17:54:24,036 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10000: MemcachedServer starting
> [transactions-repository-1-4z05w] 17:54:24,039 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10000: HotRodServer starting
> [transactions-repository-1-4z05w] 17:54:24,039 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10001: HotRodServer listening on 172.17.0.3:11222
> [transactions-repository-1-4z05w] 17:54:24,040 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10000: WebSocketServer starting
> [transactions-repository-1-4z05w] 17:54:24,040 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10001: WebSocketServer listening on 172.17.0.3:8181
> [transactions-repository-1-1f8dx] 17:54:24,046 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10000: WebSocketServer starting
> [transactions-repository-1-1f8dx] 17:54:24,045 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10000: MemcachedServer starting
> [transactions-repository-1-1f8dx] 17:54:24,046 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10000: HotRodServer starting
> [transactions-repository-1-1f8dx] 17:54:24,047 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10001: HotRodServer listening on 172.17.0.6:11222
> [transactions-repository-1-1f8dx] 17:54:24,048 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10001: MemcachedServer listening on 172.17.0.6:11211
> [transactions-repository-1-04x09] 17:54:24,051 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10000: MemcachedServer starting
> [transactions-repository-1-04x09] 17:54:24,051 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10000: WebSocketServer starting
> [transactions-repository-1-04x09] 17:54:24,052 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10000: HotRodServer starting
> [transactions-repository-1-04x09] 17:54:24,055 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10001: HotRodServer listening on 172.17.0.4:11222
> [transactions-repository-1-04x09] 17:54:24,055 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10001: MemcachedServer listening on 172.17.0.4:11211
> [transactions-repository-1-04x09] 17:54:24,056 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10001: WebSocketServer listening on 172.17.0.4:8181
> [transactions-repository-1-4z05w] 17:54:24,063 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10001: MemcachedServer listening on 172.17.0.3:11211
> [transactions-repository-1-1f8dx] 17:54:24,059 INFO [org.infinispan.server.endpoint] (MSC service thread 1-7) DGENDPT10001: WebSocketServer listening on 172.17.0.6:8181
> [transactions-repository-1-4z05w] 17:54:24,070 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10000: REST starting
> [transactions-repository-1-1f8dx] 17:54:24,079 INFO [org.infinispan.server.endpoint] (MSC service thread 1-6) DGENDPT10000: REST starting
> [transactions-repository-1-04x09] 17:54:24,071 INFO [org.infinispan.server.endpoint] (MSC service thread 1-8) DGENDPT10000: REST starting
> [transactions-repository-1-4z05w] 17:54:24,193 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t20) ISPN000310: Starting cluster-wide rebalance for cache ___protobuf_metadata, topology CacheTopology{id=2, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (1)[transactions-repository-1-4z05w: 256]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 126, transactions-repository-1-1f8dx: 130]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-1f8dx], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, ced31139-f1a1-4ee8-96af-f37c5386ecc0]}
> [transactions-repository-1-4z05w] 17:54:24,197 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t20) [Context=___protobuf_metadata][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,246 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t24) [Context=___protobuf_metadata][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,255 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t22) ISPN000310: Starting cluster-wide rebalance for cache ___script_cache, topology CacheTopology{id=2, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (1)[transactions-repository-1-4z05w: 256]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 126, transactions-repository-1-1f8dx: 130]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-1f8dx], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, ced31139-f1a1-4ee8-96af-f37c5386ecc0]}
> [transactions-repository-1-4z05w] 17:54:24,256 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t22) [Context=___script_cache][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,272 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t2) [Context=___script_cache][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,317 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) ISPN000310: Starting cluster-wide rebalance for cache ___hotRodTopologyCache, topology CacheTopology{id=2, rebalanceId=2, currentCH=ReplicatedConsistentHash{ns = 256, owners = (1)[transactions-repository-1-4z05w: 256]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 134, transactions-repository-1-04x09: 122]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-04x09], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, 5d246b27-021c-4425-b3c4-14017f378635]}
> [transactions-repository-1-4z05w] 17:54:24,318 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) [Context=___hotRodTopologyCache][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,321 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t11) [Context=___hotRodTopologyCache][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,364 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t8) [Context=___protobuf_metadata][Context=transactions-repository-1-1f8dx]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,366 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) [Context=___script_cache][Context=transactions-repository-1-1f8dx]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,382 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=___hotRodTopologyCache][Context=transactions-repository-1-04x09]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,385 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t8) ISPN000336: Finished cluster-wide rebalance for cache ___protobuf_metadata, topology id = 2
> [transactions-repository-1-4z05w] 17:54:24,387 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t8) ISPN000310: Starting cluster-wide rebalance for cache ___protobuf_metadata, topology CacheTopology{id=4, rebalanceId=3, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 126, transactions-repository-1-1f8dx: 130]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (3)[transactions-repository-1-4z05w: 90, transactions-repository-1-1f8dx: 86, transactions-repository-1-04x09: 80]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-1f8dx, transactions-repository-1-04x09], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, ced31139-f1a1-4ee8-96af-f37c5386ecc0, 5d246b27-021c-4425-b3c4-14017f378635]}
> [transactions-repository-1-4z05w] 17:54:24,388 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t8) [Context=___protobuf_metadata][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,394 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) ISPN000336: Finished cluster-wide rebalance for cache ___hotRodTopologyCache, topology id = 2
> [transactions-repository-1-4z05w] 17:54:24,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) ISPN000336: Finished cluster-wide rebalance for cache ___script_cache, topology id = 2
> [transactions-repository-1-4z05w] 17:54:24,397 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t19) [Context=___protobuf_metadata][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,397 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t7) [Context=___protobuf_metadata][Context=transactions-repository-1-1f8dx]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,398 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) ISPN000310: Starting cluster-wide rebalance for cache ___script_cache, topology CacheTopology{id=4, rebalanceId=3, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 126, transactions-repository-1-1f8dx: 130]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (3)[transactions-repository-1-4z05w: 90, transactions-repository-1-1f8dx: 86, transactions-repository-1-04x09: 80]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-1f8dx, transactions-repository-1-04x09], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, ced31139-f1a1-4ee8-96af-f37c5386ecc0, 5d246b27-021c-4425-b3c4-14017f378635]}
> [transactions-repository-1-4z05w] 17:54:24,398 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) [Context=___script_cache][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,401 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) ISPN000310: Starting cluster-wide rebalance for cache ___hotRodTopologyCache, topology CacheTopology{id=4, rebalanceId=3, currentCH=ReplicatedConsistentHash{ns = 256, owners = (2)[transactions-repository-1-4z05w: 134, transactions-repository-1-04x09: 122]}, pendingCH=ReplicatedConsistentHash{ns = 256, owners = (3)[transactions-repository-1-4z05w: 90, transactions-repository-1-04x09: 80, transactions-repository-1-1f8dx: 86]}, unionCH=null, actualMembers=[transactions-repository-1-4z05w, transactions-repository-1-04x09, transactions-repository-1-1f8dx], persistentUUIDs=[45bed168-6b22-4cc9-b164-6a8b3fe6367f, 5d246b27-021c-4425-b3c4-14017f378635, ced31139-f1a1-4ee8-96af-f37c5386ecc0]}
> [transactions-repository-1-4z05w] 17:54:24,405 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=___hotRodTopologyCache][Context=transactions-repository-1-4z05w]ISPN100002: Started local rebalance
> [transactions-repository-1-4z05w] 17:54:24,407 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t20) [Context=___hotRodTopologyCache][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,409 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t3) [Context=___script_cache][Context=transactions-repository-1-4z05w]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,420 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t11) [Context=___script_cache][Context=transactions-repository-1-1f8dx]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,425 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t11) [Context=___hotRodTopologyCache][Context=transactions-repository-1-04x09]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,476 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t17) [Context=___hotRodTopologyCache][Context=transactions-repository-1-1f8dx]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,480 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t17) ISPN000336: Finished cluster-wide rebalance for cache ___hotRodTopologyCache, topology id = 4
> [transactions-repository-1-4z05w] 17:54:24,536 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t21) [Context=___protobuf_metadata][Context=transactions-repository-1-04x09]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,537 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t21) ISPN000336: Finished cluster-wide rebalance for cache ___protobuf_metadata, topology id = 4
> [transactions-repository-1-4z05w] 17:54:24,544 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t24) [Context=___script_cache][Context=transactions-repository-1-04x09]ISPN100003: Finished local rebalance
> [transactions-repository-1-4z05w] 17:54:24,546 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t24) ISPN000336: Finished cluster-wide rebalance for cache ___script_cache, topology id = 4
> [transactions-repository-1-4z05w] 17:54:24,567 INFO [org.infinispan.rest.NettyRestServer] (MSC service thread 1-1) ISPN012003: REST server starting, listening on 172.17.0.3:8080
> [transactions-repository-1-4z05w] 17:54:24,568 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10002: REST mapped to /rest
> [transactions-repository-1-1f8dx] 17:54:24,576 INFO [org.infinispan.rest.NettyRestServer] (MSC service thread 1-6) ISPN012003: REST server starting, listening on 172.17.0.6:8080
> [transactions-repository-1-1f8dx] 17:54:24,577 INFO [org.infinispan.server.endpoint] (MSC service thread 1-6) DGENDPT10002: REST mapped to /rest
> [transactions-repository-1-04x09] 17:54:24,639 INFO [org.infinispan.rest.NettyRestServer] (MSC service thread 1-8) ISPN012003: REST server starting, listening on 172.17.0.4:8080
> [transactions-repository-1-04x09] 17:54:24,639 INFO [org.infinispan.server.endpoint] (MSC service thread 1-8) DGENDPT10002: REST mapped to /rest
> [transactions-repository-1-1f8dx] [GC (Allocation Failure) 309342K->63160K(1013632K), 0.1823599 secs]
> [transactions-repository-1-4z05w] [GC (Allocation Failure) 309352K->65174K(1013632K), 0.1616480 secs]
> [transactions-repository-1-04x09] [GC (Allocation Failure) 309268K->61649K(1013632K), 0.1507677 secs]
> [transactions-repository-1-1f8dx] 17:54:25,021 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://0.0.0.0:9990/management
> [transactions-repository-1-1f8dx] 17:54:25,022 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://0.0.0.0:9990
> [transactions-repository-1-1f8dx] 17:54:25,022 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) started in 9718ms - Started 197 of 282 services (164 services are lazy, passive or on-demand)
> [transactions-repository-1-4z05w] 17:54:25,021 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://0.0.0.0:9990/management
> [transactions-repository-1-4z05w] 17:54:25,024 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://0.0.0.0:9990
> [transactions-repository-1-4z05w] 17:54:25,027 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) started in 9643ms - Started 197 of 282 services (164 services are lazy, passive or on-demand)
> [transactions-repository-1-04x09] 17:54:25,063 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://0.0.0.0:9990/management
> [transactions-repository-1-04x09] 17:54:25,064 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://0.0.0.0:9990
> [transactions-repository-1-04x09] 17:54:25,064 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Infinispan Server 9.0.0-SNAPSHOT (WildFly Core 2.2.0.Final) started in 9746ms - Started 197 of 282 services (164 services are lazy, passive or on-demand)
> [transactions-repository-1-04x09] [GC (CMS Final Remark) 89552K(1013632K), 0.0310821 secs]
> {noformat}
> Note that I applied multiplexed logs from 3 nodes. I hope this will be helpful for diagnosing.
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * Kill some nodes
> * Start them again
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7496) InitialStateTransfer should always retry
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7496?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7496:
--------------------------------------
Parent: (was: ISPN-6673)
Issue Type: Bug (was: Sub-task)
> InitialStateTransfer should always retry
> ----------------------------------------
>
> Key: ISPN-7496
> URL: https://issues.jboss.org/browse/ISPN-7496
> Project: Infinispan
> Issue Type: Bug
> Components: Cloud Integrations
> Affects Versions: 9.0.0.Beta2
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Infinispan Server 9.0.0.Beta2
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
> Priority: Blocker
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> 13:21:40,816 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-6) MSC000001: Failed to start service jboss.datagrid-infinispan.clustered.transactions: org.jboss.msc.service.StartException in service jboss.datagrid-infinispan.clustered.transactions: Failed to start service
> at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1904)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.statetransfer.StateTransferManagerImpl.waitForInitialStateTransferToComplete() throws java.lang.Exception on object of type StateTransferManagerImpl
> at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:172)
> at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:867)
> at org.infinispan.factories.AbstractComponentRegistry.invokeStartMethods(AbstractComponentRegistry.java:633)
> at org.infinispan.factories.AbstractComponentRegistry.internalStart(AbstractComponentRegistry.java:622)
> at org.infinispan.factories.AbstractComponentRegistry.start(AbstractComponentRegistry.java:547)
> at org.infinispan.factories.ComponentRegistry.start(ComponentRegistry.java:231)
> at org.infinispan.cache.impl.CacheImpl.start(CacheImpl.java:803)
> at org.infinispan.cache.impl.AbstractDelegatingCache.start(AbstractDelegatingCache.java:411)
> at org.infinispan.manager.DefaultCacheManager.wireAndStartCache(DefaultCacheManager.java:641)
> at org.infinispan.manager.DefaultCacheManager.createCache(DefaultCacheManager.java:589)
> at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:453)
> at org.infinispan.manager.impl.AbstractDelegatingEmbeddedCacheManager.getCache(AbstractDelegatingEmbeddedCacheManager.java:139)
> at org.infinispan.server.infinispan.SecurityActions$5.run(SecurityActions.java:133)
> at org.infinispan.server.infinispan.SecurityActions$5.run(SecurityActions.java:130)
> at org.infinispan.security.Security.doPrivileged(Security.java:76)
> at org.infinispan.server.infinispan.SecurityActions.doPrivileged(SecurityActions.java:66)
> at org.infinispan.server.infinispan.SecurityActions.startCache(SecurityActions.java:138)
> at org.jboss.as.clustering.infinispan.subsystem.CacheService.start(CacheService.java:86)
> at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1948)
> at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1881)
> ... 3 more
> Caused by: org.infinispan.commons.CacheException: Initial state transfer timed out for cache transactions on transactions-repository-2-m3rqk
> at org.infinispan.statetransfer.StateTransferManagerImpl.waitForInitialStateTransferToComplete(StateTransferManagerImpl.java:228)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:168)
> ... 22 more
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/92b9fa309b1e07cbfdc7353db45ed754#file-gi...
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7494) Prevent Kubernetes from killing 2 nodes at the same time
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7494?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7494:
--------------------------------------
Parent: (was: ISPN-6673)
Issue Type: Bug (was: Sub-task)
> Prevent Kubernetes from killing 2 nodes at the same time
> --------------------------------------------------------
>
> Key: ISPN-7494
> URL: https://issues.jboss.org/browse/ISPN-7494
> Project: Infinispan
> Issue Type: Bug
> Components: Cloud Integrations
> Affects Versions: 9.0.0.Beta2
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Infinispan Server 9.0.0.Beta2
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
> Priority: Blocker
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> [transactions-repository-1-hqz3v] *** JBossAS process (83) received TERM signal ***
> [transactions-repository-1-dwl81] 09:52:09,522 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> [transactions-repository-1-dwl81] *** JBossAS process (80) received TERM signal ***
> [transactions-repository-1-hqz3v] 09:52:09,526 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/2308b4c5e9bbf523fb3e02a7cc45fa24
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Start Spring Session Demo `cd session-demo && mvn fabric8:run`
> * Create a client which inserts data (`watch -n 0.5 curl http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the rolling update: `oc deploy transactions-repository --latest -n myproject`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7491) When a node leaves the cluster it emits unsolicited state
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7491?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7491:
--------------------------------------
Parent: (was: ISPN-6673)
Issue Type: Feature Request (was: Sub-task)
> When a node leaves the cluster it emits unsolicited state
> ---------------------------------------------------------
>
> Key: ISPN-7491
> URL: https://issues.jboss.org/browse/ISPN-7491
> Project: Infinispan
> Issue Type: Feature Request
> Components: Cloud Integrations, Core
> Affects Versions: 9.0.0.CR1
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Custom Infinispan Server build (based on [these instructions|https://github.com/slaskawi/infinispan-1/tree/custom_image]). SHA1 {{2b0731b21649a88a75ed71d21b9cc06ba365e947}}
> Reporter: Sebastian Łaskawiec
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> [transactions-repository-2-1gk60] 18:26:44,264 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t22) ISPN000336: Finished cluster-wide rebalance for cache ___protobuf_metadata, topology id = 18
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 756168K->489129K(1013632K), 0.0439983 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 686020K->416468K(1013632K), 0.0514641 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 768745K->501140K(1013632K), 0.0544712 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 696084K->427206K(1013632K), 0.0997416 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 780756K->516161K(1013632K), 0.0674455 secs]
> [transactions-repository-2-jms3k] *** JBossAS process (81) received TERM signal ***
> [transactions-repository-2-jms3k] 18:26:46,371 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> [transactions-repository-2-jms3k] 18:26:46,392 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) ISPN000310: Starting cluster-wide rebalance for cache sessions, topology CacheTopology{id=25, rebalanceId=9, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,402 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,411 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,417 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,430 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-6) DGISPN0002: Stopped sessions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,441 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,448 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,451 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,455 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,456 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,453 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,470 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,471 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,495 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,497 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,494 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t61) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,490 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,477 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t59) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,474 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,513 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t6) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,527 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t14) [Context=sessions][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,529 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0019: Stopped Driver service with driver-name = h2
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,541 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,548 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) [Context=sessions][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,549 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) ISPN000336: Finished cluster-wide rebalance for cache sessions, topology id = 25
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) ISPN000310: Starting cluster-wide rebalance for cache default, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) [Context=default][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,591 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) ISPN000310: Starting cluster-wide rebalance for cache memcachedCache, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,596 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-1gk60] 18:26:46,602 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t25) [Context=default][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-jms3k] 18:26:46,599 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0002: Stopped default cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,609 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,635 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=default][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,640 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) [Context=default][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,642 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) ISPN000336: Finished cluster-wide rebalance for cache default, topology id = 21
> [transactions-repository-2-1gk60] 18:26:46,644 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t20) [Context=memcachedCache][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,661 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t9) [Context=memcachedCache][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,663 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,664 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) ISPN000336: Finished cluster-wide rebalance for cache memcachedCache, topology id = 21
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,673 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0002: Stopped memcachedCache cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,674 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,675 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,686 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,687 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,713 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,715 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,747 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,748 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,755 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,756 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,757 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,758 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,759 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,764 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,778 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0002: Stopped transactions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,802 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 6 of cache transactions
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/d789431ab5f16d46136dafffd7d4a89e
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Start Spring Session Demo `cd session-demo && mvn fabric8:run`
> * Create a client which inserts data (`watch -n 0.5 curl http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the rolling update: `oc deploy transactions-repository --latest -n myproject`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7491) When a node leaves the cluster it emits unsolicited state
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7491?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7491:
--------------------------------------
Issue Type: Bug (was: Feature Request)
> When a node leaves the cluster it emits unsolicited state
> ---------------------------------------------------------
>
> Key: ISPN-7491
> URL: https://issues.jboss.org/browse/ISPN-7491
> Project: Infinispan
> Issue Type: Bug
> Components: Cloud Integrations, Core
> Affects Versions: 9.0.0.CR1
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Custom Infinispan Server build (based on [these instructions|https://github.com/slaskawi/infinispan-1/tree/custom_image]). SHA1 {{2b0731b21649a88a75ed71d21b9cc06ba365e947}}
> Reporter: Sebastian Łaskawiec
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> [transactions-repository-2-1gk60] 18:26:44,264 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t22) ISPN000336: Finished cluster-wide rebalance for cache ___protobuf_metadata, topology id = 18
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 756168K->489129K(1013632K), 0.0439983 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 686020K->416468K(1013632K), 0.0514641 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 768745K->501140K(1013632K), 0.0544712 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 696084K->427206K(1013632K), 0.0997416 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 780756K->516161K(1013632K), 0.0674455 secs]
> [transactions-repository-2-jms3k] *** JBossAS process (81) received TERM signal ***
> [transactions-repository-2-jms3k] 18:26:46,371 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> [transactions-repository-2-jms3k] 18:26:46,392 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) ISPN000310: Starting cluster-wide rebalance for cache sessions, topology CacheTopology{id=25, rebalanceId=9, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,402 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,411 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,417 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,430 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-6) DGISPN0002: Stopped sessions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,441 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,448 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,451 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,455 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,456 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,453 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,470 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,471 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,495 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,497 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,494 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t61) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,490 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,477 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t59) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,474 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,513 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t6) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,527 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t14) [Context=sessions][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,529 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0019: Stopped Driver service with driver-name = h2
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,541 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,548 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) [Context=sessions][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,549 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) ISPN000336: Finished cluster-wide rebalance for cache sessions, topology id = 25
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) ISPN000310: Starting cluster-wide rebalance for cache default, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) [Context=default][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,591 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) ISPN000310: Starting cluster-wide rebalance for cache memcachedCache, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,596 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-1gk60] 18:26:46,602 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t25) [Context=default][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-jms3k] 18:26:46,599 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0002: Stopped default cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,609 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,635 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=default][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,640 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) [Context=default][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,642 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) ISPN000336: Finished cluster-wide rebalance for cache default, topology id = 21
> [transactions-repository-2-1gk60] 18:26:46,644 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t20) [Context=memcachedCache][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,661 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t9) [Context=memcachedCache][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,663 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,664 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) ISPN000336: Finished cluster-wide rebalance for cache memcachedCache, topology id = 21
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,673 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0002: Stopped memcachedCache cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,674 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,675 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,686 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,687 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,713 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,715 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,747 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,748 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,755 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,756 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,757 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,758 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,759 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,764 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,778 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0002: Stopped transactions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,802 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 6 of cache transactions
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/d789431ab5f16d46136dafffd7d4a89e
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Start Spring Session Demo `cd session-demo && mvn fabric8:run`
> * Create a client which inserts data (`watch -n 0.5 curl http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the rolling update: `oc deploy transactions-repository --latest -n myproject`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month
[JBoss JIRA] (ISPN-7491) When a node leaves the cluster it emits unsolicited state
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-7491?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec updated ISPN-7491:
--------------------------------------
Priority: Blocker (was: Major)
> When a node leaves the cluster it emits unsolicited state
> ---------------------------------------------------------
>
> Key: ISPN-7491
> URL: https://issues.jboss.org/browse/ISPN-7491
> Project: Infinispan
> Issue Type: Bug
> Components: Cloud Integrations, Core
> Affects Versions: 9.0.0.CR1
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Custom Infinispan Server build (based on [these instructions|https://github.com/slaskawi/infinispan-1/tree/custom_image]). SHA1 {{2b0731b21649a88a75ed71d21b9cc06ba365e947}}
> Reporter: Sebastian Łaskawiec
> Priority: Blocker
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> [transactions-repository-2-1gk60] 18:26:44,264 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t22) ISPN000336: Finished cluster-wide rebalance for cache ___protobuf_metadata, topology id = 18
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 756168K->489129K(1013632K), 0.0439983 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 686020K->416468K(1013632K), 0.0514641 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 768745K->501140K(1013632K), 0.0544712 secs]
> [transactions-repository-2-1gk60] [GC (Allocation Failure) 696084K->427206K(1013632K), 0.0997416 secs]
> [transactions-repository-2-pd4c7] [GC (Allocation Failure) 780756K->516161K(1013632K), 0.0674455 secs]
> [transactions-repository-2-jms3k] *** JBossAS process (81) received TERM signal ***
> [transactions-repository-2-jms3k] 18:26:46,371 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> [transactions-repository-2-jms3k] 18:26:46,392 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) ISPN000310: Starting cluster-wide rebalance for cache sessions, topology CacheTopology{id=25, rebalanceId=9, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,395 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t25) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,402 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,411 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,417 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,430 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-6) DGISPN0002: Stopped sessions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,441 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,444 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,448 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,450 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,451 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,455 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,456 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,453 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,470 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,471 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,466 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,495 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,497 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,473 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,494 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t61) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,490 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,477 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t24) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,476 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t59) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,475 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t54) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,474 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,513 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t6) [Context=sessions][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t57) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,514 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t60) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,515 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,516 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,527 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t14) [Context=sessions][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,529 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0019: Stopped Driver service with driver-name = h2
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,541 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,548 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) [Context=sessions][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,549 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t19) ISPN000336: Finished cluster-wide rebalance for cache sessions, topology id = 25
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,558 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) ISPN000310: Starting cluster-wide rebalance for cache default, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,574 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t10) [Context=default][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,536 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,563 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,517 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,591 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) ISPN000310: Starting cluster-wide rebalance for cache memcachedCache, topology CacheTopology{id=21, rebalanceId=10, currentCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 5+6, transactions-repository-2-pd4c7: 7+3, transactions-repository-3-6mzvd: 8+3]}, pendingCH=DefaultConsistentHash{ns=20, owners = (3)[transactions-repository-2-1gk60: 7+8, transactions-repository-2-pd4c7: 7+6, transactions-repository-3-6mzvd: 6+6]}, unionCH=null, actualMembers=[transactions-repository-2-1gk60, transactions-repository-2-pd4c7, transactions-repository-3-6mzvd], persistentUUIDs=[d47f6f69-97e8-4385-abd0-f1d43312d8c4, a17aa2e7-5137-4b5b-bf90-266207db7bb2, a000aa28-b1bd-453b-86e9-1628da898c36]}
> [transactions-repository-2-1gk60] 18:26:46,596 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100002: Started local rebalance
> [transactions-repository-2-1gk60] 18:26:46,602 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t25) [Context=default][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-jms3k] 18:26:46,599 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0002: Stopped default cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,609 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,610 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,611 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,612 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,635 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=default][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,640 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) [Context=default][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,642 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t15) ISPN000336: Finished cluster-wide rebalance for cache default, topology id = 21
> [transactions-repository-2-1gk60] 18:26:46,644 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t20) [Context=memcachedCache][Context=transactions-repository-2-pd4c7]ISPN100003: Finished local rebalance
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t55) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,641 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,661 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t9) [Context=memcachedCache][Context=transactions-repository-3-6mzvd]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,663 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) [Context=memcachedCache][Context=transactions-repository-2-1gk60]ISPN100003: Finished local rebalance
> [transactions-repository-2-1gk60] 18:26:46,664 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t22) ISPN000336: Finished cluster-wide rebalance for cache memcachedCache, topology id = 21
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,668 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,673 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-4) DGISPN0002: Stopped memcachedCache cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,674 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,675 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,679 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,686 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,687 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,713 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,715 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,722 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,728 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,729 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,747 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,748 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,753 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,755 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,756 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,757 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,758 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,759 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,760 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t64) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t62) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t65) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t58) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,766 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,765 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,763 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,764 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,774 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,777 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t53) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-jms3k] 18:26:46,778 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0002: Stopped transactions cache from clustered container
> [transactions-repository-2-pd4c7] 18:26:46,778 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,784 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t63) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 19 of cache transactions
> [transactions-repository-2-pd4c7] 18:26:46,787 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t56) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 17 of cache transactions
> [transactions-repository-2-1gk60] 18:26:46,802 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread--p7-t66) ISPN000396: Received unsolicited state from node transactions-repository-2-jms3k for segment 6 of cache transactions
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/d789431ab5f16d46136dafffd7d4a89e
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Start Spring Session Demo `cd session-demo && mvn fabric8:run`
> * Create a client which inserts data (`watch -n 0.5 curl http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the rolling update: `oc deploy transactions-repository --latest -n myproject`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
9 years, 1 month