[JBoss JIRA] (ISPN-7678) Server error when updating default cache configuration
by Tristan Tarrant (Jira)
[ https://issues.redhat.com/browse/ISPN-7678?page=com.atlassian.jira.plugin... ]
Tristan Tarrant closed ISPN-7678.
---------------------------------
Resolution: Out of Date
> Server error when updating default cache configuration
> ------------------------------------------------------
>
> Key: ISPN-7678
> URL: https://issues.redhat.com/browse/ISPN-7678
> Project: Infinispan
> Issue Type: Bug
> Components: Configuration, Server
> Affects Versions: 9.0.0.CR4
> Environment: Run the server with the default configuration in domain mode.
> Reporter: Ryan Emerson
> Assignee: Tristan Tarrant
> Priority: Major
> Fix For: 9.0.0.Final
>
>
> {code:java}
> [Server:server-one] 13:34:26,304 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-3) DGISPN0002: Stopped default cache from clustered container
> [Server:server-two] 13:34:26,311 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) ISPN000310: Starting cluster-wide rebalance for cache default, topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=20, owners = (1)[master:server-two: 20+0]}, pendingCH=DefaultConsistentHash{ns=20, owners = (2)[master:server-two: 10+10, master:server-one: 10+10]}, unionCH=null, actualMembers=[master:server-two, master:server-one], persistentUUIDs=[ca1b2fd7-2f90-4439-88e6-ca202f1bded4, 069b35d1-2d9d-4ca4-bf14-c01fa80bf86a]}
> [Server:server-two] 13:34:26,311 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t2) [Context=default][Context=master:server-two]ISPN100002: Started local rebalance
> [Server:server-two] 13:34:26,312 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t9) [Context=default][Context=master:server-two]ISPN100003: Finished local rebalance
> [Server:server-two] 13:34:26,318 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) [Context=default][Context=master:server-one]ISPN100003: Finished local rebalance
> [Server:server-two] 13:34:26,320 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t6) ISPN000336: Finished cluster-wide rebalance for cache default, topology id = 5
> [Server:server-one] 13:34:26,321 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-2) DGISPN0001: Started default cache from clustered container
> [Server:server-one] 13:34:26,321 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10000: MemcachedServer starting
> [Server:server-one] 13:34:26,321 INFO [org.infinispan.server.endpoint] (MSC service thread 1-2) DGENDPT10001: MemcachedServer listening on 127.0.0.1:11211
> [Server:server-one] 13:34:26,321 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10000: REST starting
> [Server:server-one] 13:34:26,321 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10000: WebSocketServer starting
> [Server:server-one] 13:34:26,322 INFO [org.infinispan.server.endpoint] (MSC service thread 1-4) DGENDPT10001: WebSocketServer listening on 127.0.0.1:8181
> [Server:server-one] 13:34:26,321 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10000: HotRodServer starting
> [Server:server-one] 13:34:26,322 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10001: HotRodServer listening on 127.0.0.1:11222
> [Server:server-two] 13:34:26,341 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-8) DGISPN0002: Stopped default cache from clustered container
> [Server:server-one] 13:34:26,349 INFO [org.infinispan.rest.embedded.netty4.NettyRestServer] (MSC service thread 1-3) ISPN012003: REST server starting, listening on 127.0.0.1:8080
> [Server:server-one] 13:34:26,350 INFO [org.infinispan.server.endpoint] (MSC service thread 1-3) DGENDPT10002: REST mapped to rest/rest
> [Server:server-two] 13:34:26,351 INFO [org.infinispan.CLUSTER] (MSC service thread 1-8) ISPN000310: Starting cluster-wide rebalance for cache default, topology CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=20, owners = (1)[master:server-one: 20+0]}, pendingCH=DefaultConsistentHash{ns=20, owners = (2)[master:server-one: 10+10, master:server-two: 10+10]}, unionCH=null, actualMembers=[master:server-one, master:server-two], persistentUUIDs=[069b35d1-2d9d-4ca4-bf14-c01fa80bf86a, ca1b2fd7-2f90-4439-88e6-ca202f1bded4]}
> [Server:server-two] 13:34:26,351 INFO [org.infinispan.CLUSTER] (MSC service thread 1-8) [Context=default][Context=master:server-two]ISPN100002: Started local rebalance
> [Server:server-two] 13:34:26,353 INFO [org.infinispan.CLUSTER] (remote-thread--p2-t7) [Context=default][Context=master:server-one]ISPN100003: Finished local rebalance
> [Server:server-two] 13:34:26,366 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t19) [Context=default][Context=master:server-two]ISPN100003: Finished local rebalance
> [Server:server-two] 13:34:26,367 INFO [org.infinispan.CLUSTER] (transport-thread--p4-t19) ISPN000336: Finished cluster-wide rebalance for cache default, topology id = 8
> [Server:server-two] 13:34:26,368 INFO [org.jboss.as.clustering.infinispan] (MSC service thread 1-8) DGISPN0001: Started default cache from clustered container
> [Server:server-two] 13:34:26,368 INFO [org.infinispan.server.endpoint] (MSC service thread 1-8) DGENDPT10000: WebSocketServer starting
> [Server:server-two] 13:34:26,368 INFO [org.infinispan.server.endpoint] (MSC service thread 1-6) DGENDPT10000: HotRodServer starting
> [Server:server-two] 13:34:26,368 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10000: MemcachedServer starting
> [Server:server-two] 13:34:26,369 INFO [org.infinispan.server.endpoint] (MSC service thread 1-8) DGENDPT10001: WebSocketServer listening on 127.0.0.1:8331
> [Server:server-two] 13:34:26,369 INFO [org.infinispan.server.endpoint] (MSC service thread 1-6) DGENDPT10001: HotRodServer listening on 127.0.0.1:11372
> [Server:server-two] 13:34:26,369 INFO [org.infinispan.server.endpoint] (MSC service thread 1-1) DGENDPT10001: MemcachedServer listening on 127.0.0.1:11361
> [Server:server-two] 13:34:26,369 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10000: REST starting
> [Server:server-two] 13:34:26,407 INFO [org.infinispan.rest.embedded.netty4.NettyRestServer] (MSC service thread 1-5) ISPN012003: REST server starting, listening on 127.0.0.1:8230
> [Server:server-two] 13:34:26,408 INFO [org.infinispan.server.endpoint] (MSC service thread 1-5) DGENDPT10002: REST mapped to rest/rest
> [Server:server-one] 13:34:27,437 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-5) MSC000001: Failed to start service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: org.jboss.msc.service.StartException in service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: DGENDPT10004: Failed to start HotRodServer
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.start(ProtocolServerService.java:156)
> [Server:server-one] at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1948)
> [Server:server-one] at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1881)
> [Server:server-one] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [Server:server-one] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [Server:server-one] at java.lang.Thread.run(Thread.java:745)
> [Server:server-one] Caused by: org.infinispan.commons.CacheConfigurationException: ISPN000358: A cache configuration named ___hotRodTopologyCache already exists. This cannot be configured externally by the user.
> [Server:server-one] at org.infinispan.registry.impl.InternalCacheRegistryImpl.registerInternalCache(InternalCacheRegistryImpl.java:58)
> [Server:server-one] at org.infinispan.server.hotrod.HotRodServer.defineTopologyCacheConfig(HotRodServer.java:265)
> [Server:server-one] at org.infinispan.server.hotrod.HotRodServer.startInternal(HotRodServer.java:163)
> [Server:server-one] at org.infinispan.server.hotrod.HotRodServer.startInternal(HotRodServer.java:82)
> [Server:server-one] at org.infinispan.server.core.AbstractProtocolServer.start(AbstractProtocolServer.java:80)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.SecurityActions$6.run(SecurityActions.java:136)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.SecurityActions$6.run(SecurityActions.java:133)
> [Server:server-one] at org.infinispan.security.Security.doPrivileged(Security.java:76)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.SecurityActions.doPrivileged(SecurityActions.java:42)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.SecurityActions.startProtocolServer(SecurityActions.java:140)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.startProtocolServer(ProtocolServerService.java:190)
> [Server:server-one] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.start(ProtocolServerService.java:148)
> [Server:server-one] ... 5 more
> [Server:server-one]
> [Server:server-two] 13:34:27,493 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-6) MSC000001: Failed to start service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: org.jboss.msc.service.StartException in service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: DGENDPT10004: Failed to start HotRodServer
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.start(ProtocolServerService.java:156)
> [Server:server-two] at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1948)
> [Server:server-two] at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1881)
> [Server:server-two] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [Server:server-two] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [Server:server-two] at java.lang.Thread.run(Thread.java:745)
> [Server:server-two] Caused by: org.infinispan.commons.CacheConfigurationException: ISPN000358: A cache configuration named ___hotRodTopologyCache already exists. This cannot be configured externally by the user.
> [Server:server-two] at org.infinispan.registry.impl.InternalCacheRegistryImpl.registerInternalCache(InternalCacheRegistryImpl.java:58)
> [Server:server-two] at org.infinispan.server.hotrod.HotRodServer.defineTopologyCacheConfig(HotRodServer.java:265)
> [Server:server-two] at org.infinispan.server.hotrod.HotRodServer.startInternal(HotRodServer.java:163)
> [Server:server-two] at org.infinispan.server.hotrod.HotRodServer.startInternal(HotRodServer.java:82)
> [Server:server-two] at org.infinispan.server.core.AbstractProtocolServer.start(AbstractProtocolServer.java:80)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.SecurityActions$6.run(SecurityActions.java:136)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.SecurityActions$6.run(SecurityActions.java:133)
> [Server:server-two] at org.infinispan.security.Security.doPrivileged(Security.java:76)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.SecurityActions.doPrivileged(SecurityActions.java:42)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.SecurityActions.startProtocolServer(SecurityActions.java:140)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.startProtocolServer(ProtocolServerService.java:190)
> [Server:server-two] at org.infinispan.server.endpoint.subsystem.ProtocolServerService.start(ProtocolServerService.java:148)
> [Server:server-two] ... 5 more
> [Server:server-two]
> [Server:server-two] 13:34:27,528 INFO [org.jboss.as.controller] (ServerService Thread Pool -- 15) WFLYCTL0183: Service status report
> [Server:server-two] WFLYCTL0186: Services which failed to start: service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: org.jboss.msc.service.StartException in service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: DGENDPT10004: Failed to start HotRodServer
> [Server:server-two]
> [Server:server-one] 13:34:27,528 INFO [org.jboss.as.controller] (ServerService Thread Pool -- 30) WFLYCTL0183: Service status report
> [Server:server-one] WFLYCTL0186: Services which failed to start: service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: org.jboss.msc.service.StartException in service jboss.datagrid-infinispan-endpoint.hotrod.hotrod-connector: DGENDPT10004: Failed to start HotRodServer
> [Server:server-one]
> {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (ISPN-9817) OOM Error on ExposedByteArrayOutputStream
by Tristan Tarrant (Jira)
[ https://issues.redhat.com/browse/ISPN-9817?page=com.atlassian.jira.plugin... ]
Tristan Tarrant closed ISPN-9817.
---------------------------------
Resolution: Out of Date
The replication queue was removed in ISPN-6417
> OOM Error on ExposedByteArrayOutputStream
> -----------------------------------------
>
> Key: ISPN-9817
> URL: https://issues.redhat.com/browse/ISPN-9817
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 7.2.4.Final
> Reporter: Rakesh Vende
> Priority: Critical
> Fix For: 7.2.4.Final
>
> Attachments: 11.jpg
>
>
> Titile - OOM Error on ExposedByteArrayOutputStream
> Data -
> 1. Replication Mode is Async
> 2. queue-size="500"
> 3. queue-flush-interval="10000"
> Details -
> 1. Application threads frequently calling put method on replicated cache results in calling flush method of ReplicationQueueImpl.java
> 2. This cause application threads to wait for every 500th put call to complete the cache replication from the queue
> 3. This becomes kind of sync replication which blocks application threads.
> 4. To avoid this situation, we can increase the queue size large enough, which, apparently, does not have any side effect as queue is linked blocking queue and application threads will only get blocked when queue becomes full.
> 5. However this puts pressure on aysnc queue, which has to replicate entire queue at once.
> _replicationQueue-thread--p4-t1 tid=119 [RUNNABLE] [DAEMON] <--- OutOfMemoryError happened in this thread
> java.lang.OutOfMemoryError.<init>() OutOfMemoryError.java:48
> org.infinispan.commons.io.ExposedByteArrayOutputStream.write(byte[], int, int) ExposedByteArrayOutputStream.java:71
> _
> 6. This out of memory happens when JVM fails to allocate continuations chunk of memory in the form of array of 1 or 2 GB
> Summary - If we set queue size to normal or low level, application threads result in calling flush which turns out to be sync replication which blocks other application threads. And, if I increase the queue size to maximum enough so as to avoid sync flush then replication queue throws OOM
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (ISPN-11336) Infinispan BOM should only have plugin management
by Stéphane Nicoll (Jira)
Stéphane Nicoll created ISPN-11336:
--------------------------------------
Summary: Infinispan BOM should only have plugin management
Key: ISPN-11336
URL: https://issues.redhat.com/browse/ISPN-11336
Project: Infinispan
Issue Type: Bug
Components: Build
Affects Versions: 10.1.2.Final
Reporter: Stéphane Nicoll
The BOM has a {{pluginManagement}} section that's a bit misleading since Maven isn't going to do anything with it.
It is also invalid at the moment per the following:
{code:xml}
<plugin>
<groupId>org.infinispan.maven-plugins</groupId>
<artifactId>protocol-parser-generator</artifactId>
<version>${version.infinispan.maven-plugins}</version>
</plugin>
{code}
This artifact does not seem to be published anymore. Using the BOM with resolution leads to
{noformat}
[WARNING] The POM for org.infinispan:infinispan-protocol-parser-generator-maven-plugin:jar:10.1.1.Final is missing, no dependency information available
[WARNING] Failed to retrieve plugin descriptor for org.infinispan:infinispan-protocol-parser-generator-maven-plugin:10.1.1.Final: Plugin org.infinispan:infinispan-protocol-parser-generator-maven-plugin:10.1.1.Final or one of its dependencies could not be resolved: Failure to find org.infinispan:infinispan-protocol-parser-generator-maven-plugin:jar:10.1.1.Final in https://repo.spring.io/milestone was cached in the local repository, resolution will not be reattempted until the update interval of spring-milestones has elapsed or updates are forced
{noformat}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (ISPN-11336) Infinispan BOM should only have dependency management
by Stéphane Nicoll (Jira)
[ https://issues.redhat.com/browse/ISPN-11336?page=com.atlassian.jira.plugi... ]
Stéphane Nicoll updated ISPN-11336:
-----------------------------------
Summary: Infinispan BOM should only have dependency management (was: Infinispan BOM should only have plugin management)
> Infinispan BOM should only have dependency management
> -----------------------------------------------------
>
> Key: ISPN-11336
> URL: https://issues.redhat.com/browse/ISPN-11336
> Project: Infinispan
> Issue Type: Bug
> Components: Build
> Affects Versions: 10.1.2.Final
> Reporter: Stéphane Nicoll
> Priority: Major
>
> The BOM has a {{pluginManagement}} section that's a bit misleading since Maven isn't going to do anything with it.
> It is also invalid at the moment per the following:
> {code:xml}
> <plugin>
> <groupId>org.infinispan.maven-plugins</groupId>
> <artifactId>protocol-parser-generator</artifactId>
> <version>${version.infinispan.maven-plugins}</version>
> </plugin>
> {code}
> This artifact does not seem to be published anymore. Using the BOM with resolution leads to
> {noformat}
> [WARNING] The POM for org.infinispan:infinispan-protocol-parser-generator-maven-plugin:jar:10.1.1.Final is missing, no dependency information available
> [WARNING] Failed to retrieve plugin descriptor for org.infinispan:infinispan-protocol-parser-generator-maven-plugin:10.1.1.Final: Plugin org.infinispan:infinispan-protocol-parser-generator-maven-plugin:10.1.1.Final or one of its dependencies could not be resolved: Failure to find org.infinispan:infinispan-protocol-parser-generator-maven-plugin:jar:10.1.1.Final in https://repo.spring.io/milestone was cached in the local repository, resolution will not be reattempted until the update interval of spring-milestones has elapsed or updates are forced
> {noformat}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month