[
https://issues.jboss.org/browse/ISPN-7493?page=com.atlassian.jira.plugin....
]
Sebastian Łaskawiec commented on ISPN-7493:
-------------------------------------------
So it seems the node said goodbye:
{noformat}
[transactions-repository-1-ds1ks] 09:50:50,669 INFO [org.jboss.as.clustering.infinispan]
(MSC service thread 1-7) DGISPN0002: Stopped transactional cache from clustered container
[transactions-repository-1-ds1ks] 09:50:50,681 INFO
[org.infinispan.globalstate.impl.GlobalStateManagerImpl] (MSC service thread 1-7)
ISPN000390: Persisted state, version=9.0.0.Beta2 timestamp=2017-02-20T09:50:50.681Z
[transactions-repository-1-ds1ks] 09:50:50,683 INFO
[org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7)
ISPN000080: Disconnecting JGroups channel clustered
[transactions-repository-1-ds1ks] 09:50:50,685 INFO
[org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7)
ISPN000082: Stopping the RpcDispatcher for channel clustered
{noformat}
But then it received (and tried to process) command:
{noformat}
[transactions-repository-1-ds1ks] 09:50:50,698 WARN
[org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler]
(remote-thread--p2-t3) ISPN000071: Caught exception when handling command
CacheTopologyControlCommand{cache=transactional, type=STABLE_TOPOLOGY_UPDATE,
sender=transactions-repository-1-dwl81, joinInfo=null, topologyId=8, rebalanceId=4,
currentCH=DefaultConsistentHash{ns=80, owners = (2)[transactions-repository-1-dwl81:
41+39, transactions-repository-1-hqz3v: 39+41]}, pendingCH=null, availabilityMode=null,
actualMembers=[transactions-repository-1-dwl81, transactions-repository-1-hqz3v],
throwable=null, viewId=3}: org.infinispan.commons.CacheConfigurationException: Unable to
configure component (type: class org.infinispan.topology.CacheTopologyControlCommand,
instance CacheTopologyControlCommand{cache=transactional, type=STABLE_TOPOLOGY_UPDATE,
sender=transactions-repository-1-dwl81, joinInfo=null, topologyId=8, rebalanceId=4,
currentCH=DefaultConsistentHash{ns=80, owners = (2)[transactions-repository-1-dwl81:
41+39, transactions-repository-1-hqz3v: 39+41]}, pendingCH=null, availabilityMode=null,
actualMembers=[transactions-repository-1-dwl81, transactions-repository-1-hqz3v],
throwable=null, viewId=3})
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.wireDependencies(AbstractComponentRegistry.java:152)
[transactions-repository-1-ds1ks] at
org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler$2.run(GlobalInboundInvocationHandler.java:160)
[transactions-repository-1-ds1ks] at
org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl$RunnableWrapper.run(BlockingTaskAwareExecutorServiceImpl.java:203)
[transactions-repository-1-ds1ks] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[transactions-repository-1-ds1ks] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[transactions-repository-1-ds1ks] at java.lang.Thread.run(Thread.java:745)
[transactions-repository-1-ds1ks] Caused by:
org.infinispan.IllegalLifecycleStateException: Trying to register a component after
stopping: org.infinispan.topology.LocalTopologyManagerFactory
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.registerComponentInternal(AbstractComponentRegistry.java:185)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.registerComponent(AbstractComponentRegistry.java:172)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.registerComponent(AbstractComponentRegistry.java:168)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.createComponentFactoryInternal(AbstractComponentRegistry.java:349)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.getFactory(AbstractComponentRegistry.java:328)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.getOrCreateComponent(AbstractComponentRegistry.java:294)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.invokeInjectionMethod(AbstractComponentRegistry.java:247)
[transactions-repository-1-ds1ks] at
org.infinispan.factories.AbstractComponentRegistry.wireDependencies(AbstractComponentRegistry.java:148)
[transactions-repository-1-ds1ks] ... 5 more
[transactions-repository-1-ds1ks]
{noformat}
That's probably something that caused
[
ISPN-7488|https://issues.jboss.org/browse/ISPN-7488]
Cannot remove cache configuration while performing Rolling Update
-----------------------------------------------------------------
Key: ISPN-7493
URL:
https://issues.jboss.org/browse/ISPN-7493
Project: Infinispan
Issue Type: Sub-task
Components: Cloud Integrations, Core
Affects Versions: 9.0.0.CR1
Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
* Infinispan Server 9.0.0.Beta2
Reporter: Sebastian Łaskawiec
When I was performing [Spring Session and Kubernetes Rolling Update
demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
One of the is this:
{noformat}
[transactions-repository-1-ds1ks] *** JBossAS process (81) received TERM signal ***
[transactions-repository-1-ds1ks] 09:50:49,010 INFO [org.jboss.as.server] (Thread-2)
WFLYSRV0220: Server shutdown has been requested via an OS signal
[transactions-repository-1-ds1ks] 09:50:49,060 WARN [org.jboss.msc.service.fail] (MSC
service thread 1-6) MSC000004: Failure during stop of service
jboss.datagrid-infinispan.clustered.transactional.config: java.lang.IllegalStateException:
ISPN000371: Cannot remove cache configuration 'transactional' because it is in
use
[transactions-repository-1-ds1ks] at
org.infinispan.manager.DefaultCacheManager.undefineConfiguration(DefaultCacheManager.java:391)
[transactions-repository-1-ds1ks] at
org.infinispan.manager.impl.AbstractDelegatingEmbeddedCacheManager.undefineConfiguration(AbstractDelegatingEmbeddedCacheManager.java:49)
[transactions-repository-1-ds1ks] at
org.infinispan.server.infinispan.SecurityActions$4.run(SecurityActions.java:120)
[transactions-repository-1-ds1ks] at
org.infinispan.server.infinispan.SecurityActions$4.run(SecurityActions.java:117)
[transactions-repository-1-ds1ks] at
org.infinispan.security.Security.doPrivileged(Security.java:76)
[transactions-repository-1-ds1ks] at
org.infinispan.server.infinispan.SecurityActions.doPrivileged(SecurityActions.java:64)
[transactions-repository-1-ds1ks] at
org.infinispan.server.infinispan.SecurityActions.undefineContainerConfiguration(SecurityActions.java:124)
[transactions-repository-1-ds1ks] at
org.jboss.as.clustering.infinispan.subsystem.AbstractCacheConfigurationService.stop(AbstractCacheConfigurationService.java:89)
[transactions-repository-1-ds1ks] at
org.jboss.msc.service.ServiceControllerImpl$StopTask.stopService(ServiceControllerImpl.java:2056)
[transactions-repository-1-ds1ks] at
org.jboss.msc.service.ServiceControllerImpl$StopTask.run(ServiceControllerImpl.java:2017)
[transactions-repository-1-ds1ks] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[transactions-repository-1-ds1ks] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[transactions-repository-1-ds1ks] at java.lang.Thread.run(Thread.java:745)
{noformat}
Full logs from Rolling Update process might be found here:
https://gist.github.com/slaskawi/2308b4c5e9bbf523fb3e02a7cc45fa24
Steps to reproduce:
* Start local OpenShift Cluster
* invoke `./init_infrastructure.sh` from
https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
* invoke `cd transaction-creator && mvn fabric8:run`
* Start Spring Session Demo `cd session-demo && mvn fabric8:run`
* Create a client which inserts data (`watch -n 0.5 curl
http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the
rolling update: `oc deploy transactions-repository --latest -n myproject`
* Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)