[infinispan-issues] [JBoss JIRA] (ISPN-7493) Cannot remove cache configuration while performing Rolling Update
Sebastian Łaskawiec (JIRA)
issues at jboss.org
Mon Feb 20 05:04:00 EST 2017
[ https://issues.jboss.org/browse/ISPN-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13365962#comment-13365962 ]
Sebastian Łaskawiec commented on ISPN-7493:
-------------------------------------------
So it seems the node said goodbye:
{noformat}
[transactions-repository-1-ds1ks] 09:50:50,669 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-7) DGISPN0002: Stopped transactional cache from clustered container
[transactions-repository-1-ds1ks] 09:50:50,681 INFO [org.infinispan.globalstate.impl.GlobalStateManagerImpl] (MSC service thread 1-7) ISPN000390: Persisted state, version=9.0.0.Beta2 timestamp=2017-02-20T09:50:50.681Z
[transactions-repository-1-ds1ks] 09:50:50,683 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000080: Disconnecting JGroups channel clustered
[transactions-repository-1-ds1ks] 09:50:50,685 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000082: Stopping the RpcDispatcher for channel clustered
{noformat}
But then it received (and tried to process) command:
{noformat}
[transactions-repository-1-ds1ks] 09:50:50,698 WARN [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (remote-thread--p2-t3) ISPN000071: Caught exception when handling command CacheTopologyControlCommand{cache=transactional, type=STABLE_TOPOLOGY_UPDATE, sender=transactions-repository-1-dwl81, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=80, owners = (2)[transactions-repository-1-dwl81: 41+39, transactions-repository-1-hqz3v: 39+41]}, pendingCH=null, availabilityMode=null, actualMembers=[transactions-repository-1-dwl81, transactions-repository-1-hqz3v], throwable=null, viewId=3}: org.infinispan.commons.CacheConfigurationException: Unable to configure component (type: class org.infinispan.topology.CacheTopologyControlCommand, instance CacheTopologyControlCommand{cache=transactional, type=STABLE_TOPOLOGY_UPDATE, sender=transactions-repository-1-dwl81, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=80, owners = (2)[transactions-repository-1-dwl81: 41+39, transactions-repository-1-hqz3v: 39+41]}, pendingCH=null, availabilityMode=null, actualMembers=[transactions-repository-1-dwl81, transactions-repository-1-hqz3v], throwable=null, viewId=3})
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.wireDependencies(AbstractComponentRegistry.java:152)
[transactions-repository-1-ds1ks] at org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler$2.run(GlobalInboundInvocationHandler.java:160)
[transactions-repository-1-ds1ks] at org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl$RunnableWrapper.run(BlockingTaskAwareExecutorServiceImpl.java:203)
[transactions-repository-1-ds1ks] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[transactions-repository-1-ds1ks] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[transactions-repository-1-ds1ks] at java.lang.Thread.run(Thread.java:745)
[transactions-repository-1-ds1ks] Caused by: org.infinispan.IllegalLifecycleStateException: Trying to register a component after stopping: org.infinispan.topology.LocalTopologyManagerFactory
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.registerComponentInternal(AbstractComponentRegistry.java:185)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.registerComponent(AbstractComponentRegistry.java:172)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.registerComponent(AbstractComponentRegistry.java:168)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.createComponentFactoryInternal(AbstractComponentRegistry.java:349)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.getFactory(AbstractComponentRegistry.java:328)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.getOrCreateComponent(AbstractComponentRegistry.java:294)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.invokeInjectionMethod(AbstractComponentRegistry.java:247)
[transactions-repository-1-ds1ks] at org.infinispan.factories.AbstractComponentRegistry.wireDependencies(AbstractComponentRegistry.java:148)
[transactions-repository-1-ds1ks] ... 5 more
[transactions-repository-1-ds1ks]
{noformat}
That's probably something that caused [ISPN-7488|https://issues.jboss.org/browse/ISPN-7488]
> Cannot remove cache configuration while performing Rolling Update
> -----------------------------------------------------------------
>
> Key: ISPN-7493
> URL: https://issues.jboss.org/browse/ISPN-7493
> Project: Infinispan
> Issue Type: Sub-task
> Components: Cloud Integrations, Core
> Affects Versions: 9.0.0.CR1
> Environment: * OpenShift {{v1.5.0-alpha.2+e4b43ee}}
> * Infinispan Server 9.0.0.Beta2
> Reporter: Sebastian Łaskawiec
>
> When I was performing [Spring Session and Kubernetes Rolling Update demo|https://bluejeans.com/s/pYKUg/] I encountered a couple of problems.
> One of the is this:
> {noformat}
> [transactions-repository-1-ds1ks] *** JBossAS process (81) received TERM signal ***
> [transactions-repository-1-ds1ks] 09:50:49,010 INFO [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested via an OS signal
> [transactions-repository-1-ds1ks] 09:50:49,060 WARN [org.jboss.msc.service.fail] (MSC service thread 1-6) MSC000004: Failure during stop of service jboss.datagrid-infinispan.clustered.transactional.config: java.lang.IllegalStateException: ISPN000371: Cannot remove cache configuration 'transactional' because it is in use
> [transactions-repository-1-ds1ks] at org.infinispan.manager.DefaultCacheManager.undefineConfiguration(DefaultCacheManager.java:391)
> [transactions-repository-1-ds1ks] at org.infinispan.manager.impl.AbstractDelegatingEmbeddedCacheManager.undefineConfiguration(AbstractDelegatingEmbeddedCacheManager.java:49)
> [transactions-repository-1-ds1ks] at org.infinispan.server.infinispan.SecurityActions$4.run(SecurityActions.java:120)
> [transactions-repository-1-ds1ks] at org.infinispan.server.infinispan.SecurityActions$4.run(SecurityActions.java:117)
> [transactions-repository-1-ds1ks] at org.infinispan.security.Security.doPrivileged(Security.java:76)
> [transactions-repository-1-ds1ks] at org.infinispan.server.infinispan.SecurityActions.doPrivileged(SecurityActions.java:64)
> [transactions-repository-1-ds1ks] at org.infinispan.server.infinispan.SecurityActions.undefineContainerConfiguration(SecurityActions.java:124)
> [transactions-repository-1-ds1ks] at org.jboss.as.clustering.infinispan.subsystem.AbstractCacheConfigurationService.stop(AbstractCacheConfigurationService.java:89)
> [transactions-repository-1-ds1ks] at org.jboss.msc.service.ServiceControllerImpl$StopTask.stopService(ServiceControllerImpl.java:2056)
> [transactions-repository-1-ds1ks] at org.jboss.msc.service.ServiceControllerImpl$StopTask.run(ServiceControllerImpl.java:2017)
> [transactions-repository-1-ds1ks] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [transactions-repository-1-ds1ks] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [transactions-repository-1-ds1ks] at java.lang.Thread.run(Thread.java:745)
> {noformat}
> Full logs from Rolling Update process might be found here: https://gist.github.com/slaskawi/2308b4c5e9bbf523fb3e02a7cc45fa24
> Steps to reproduce:
> * Start local OpenShift Cluster
> * invoke `./init_infrastructure.sh` from https://github.com/slaskawi/presentations/tree/ISPN-7487-reproducer
> * invoke `cd transaction-creator && mvn fabric8:run`
> * Start Spring Session Demo `cd session-demo && mvn fabric8:run`
> * Create a client which inserts data (`watch -n 0.5 curl http://<spring-session-demo-pod-ip>/sessions`) and at the same time invoke the rolling update: `oc deploy transactions-repository --latest -n myproject`
> * Observe logs `kubetail -l environment=infrastructure`
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
More information about the infinispan-issues
mailing list