[JBoss JIRA] (ISPN-8167) Archive debug logs in CI
by Dan Berindei (JIRA)
Dan Berindei created ISPN-8167:
----------------------------------
Summary: Archive debug logs in CI
Key: ISPN-8167
URL: https://issues.jboss.org/browse/ISPN-8167
Project: Infinispan
Issue Type: Task
Components: Build process
Affects Versions: 9.1.0.Final
Reporter: Dan Berindei
Assignee: Dan Berindei
Fix For: 9.1.1.Final
The default log4j2 configuration file used by the test suite logs everything at DEBUG level, but our current Jenkins build discards those logs. We should archive them to help track down random test failures.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-5151) DistributedSharedCacheTwoNodesMapReduceTest.testInvokeMapReduceOnAllKeys random failures
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-5151?page=com.atlassian.jira.plugin.... ]
Dan Berindei resolved ISPN-5151.
--------------------------------
Fix Version/s: 9.0.0.Final
(was: 9.2.0.Final)
Resolution: Out of Date
Map/reduce tests were removed with ISPN-6354 in 9.0.
> DistributedSharedCacheTwoNodesMapReduceTest.testInvokeMapReduceOnAllKeys random failures
> ----------------------------------------------------------------------------------------
>
> Key: ISPN-5151
> URL: https://issues.jboss.org/browse/ISPN-5151
> Project: Infinispan
> Issue Type: Bug
> Components: Core, Test Suite - Core
> Affects Versions: 7.0.3.Final
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Blocker
> Labels: testsuite_stability
> Fix For: 9.0.0.Final
>
>
> The method {{invokeMapReduce()}} doesn't really invoke the M/R task, it only creates it, and the execution only starts when the test method calls {{task.execute()}} explicitly. It shouldn't try to check the contents of the shared intermediary cache, because the intermediary cache may not exist yet - and it may accidentally create it with the wrong configuration. I get this error when I run only the {{testInvokeMapReduceOnAllKeys}} method:
> {noformat}
> 09:55:37,632 TRACE (testng-DistributedSharedCacheTwoNodesMapReduceTest:) [DefaultCacheManager] About to wire and start cache __tmpMapReduce
> 09:55:37,646 DEBUG (testng-DistributedSharedCacheTwoNodesMapReduceTest:) [MapReduceTask] Invoking CreateCacheCommand{cacheManager=null, cacheNameToCreate='__tmpMapReduce', cacheConfigurationName='__tmpMapReduce', start=true', size=2} across members [DistributedSharedCacheTwoNodesMapReduceTest-NodeA-19271, DistributedSharedCacheTwoNodesMapReduceTest-NodeB-10341]
> 10:32:56,324 ERROR (testng-DistributedSharedCacheTwoNodesMapReduceTest:) [UnitTestTestNGListener] Test testInvokeMapReduceOnAllKeys(org.infinispan.distexec.mapreduce.DistributedSharedCacheTwoNodesMapReduceTest) failed.
> org.infinispan.distexec.mapreduce.MapReduceException: Map phase failed
> at org.infinispan.distexec.mapreduce.MapReduceTask.executeMapPhase(MapReduceTask.java:607)
> at org.infinispan.distexec.mapreduce.MapReduceTask.executeHelper(MapReduceTask.java:473)
> at org.infinispan.distexec.mapreduce.MapReduceTask.execute(MapReduceTask.java:414)
> at org.infinispan.distexec.mapreduce.BaseWordCountMapReduceTest.testInvokeMapReduceOnAllKeys(BaseWordCountMapReduceTest.java:162)
> Caused by: org.infinispan.commons.CacheException: java.lang.NullPointerException
> at org.infinispan.distexec.mapreduce.MapReduceManagerImpl.mapAndCombineForDistributedReduction(MapReduceManagerImpl.java:105)
> at org.infinispan.distexec.mapreduce.MapReduceTask$MapTaskPart.invokeMapCombineLocally(MapReduceTask.java:1174)
> at org.infinispan.distexec.mapreduce.MapReduceTask$MapTaskPart.access$300(MapReduceTask.java:1101)
> at org.infinispan.distexec.mapreduce.MapReduceTask$MapTaskPart$1.call(MapReduceTask.java:1123)
> at org.infinispan.distexec.mapreduce.MapReduceTask$MapTaskPart$1.call(MapReduceTask.java:1119)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at org.infinispan.distexec.mapreduce.MapReduceManagerImpl.mapKeysToNodes(MapReduceManagerImpl.java:363)
> at org.infinispan.distexec.mapreduce.MapReduceManagerImpl.migrateIntermediateKeysAndValues(MapReduceManagerImpl.java:327)
> at org.infinispan.distexec.mapreduce.MapReduceManagerImpl.mapAndCombine(MapReduceManagerImpl.java:260)
> at org.infinispan.distexec.mapreduce.MapReduceManagerImpl.mapAndCombineForDistributedReduction(MapReduceManagerImpl.java:103)
> ... 10 more
> {noformat}
> Even if the check is moved after the M/R task is finished, it still wouldn't be correct, because the task only cleans up the shared intermediary cache asynchronously. So it needs to use {{eventually()}} to avoid errors like this:
> {noformat}
> 04:06:32,260 ERROR (testng-DistributedSharedCacheTwoNodesMapReduceTest:) [UnitTestTestNGListener] Test testInvokeMapReduceOnAllKeys(org.infinispan.distexec.mapreduce.DistributedSharedCacheTwoNodesMapReduceTest) failed.
> java.lang.AssertionError: Shared cache __tmpMapReduce is not empty. It has 5 keys/values: [ImmortalCacheEntry{key=IntermediateCompositeKey [taskId=88948a8b-2a8a-4c13-bc45-4dc3a9f6b0fb, key=is], value=org.infinispan.distexec.mapreduce.MapReduceManagerImpl$DeltaAwareList@21ae10d3}, ImmortalCacheEntry{key=IntermediateCompositeKey [taskId=88948a8b-2a8a-4c13-bc45-4dc3a9f6b0fb, key=JUDCon], value=org.infinispan.distexec.mapreduce.MapReduceManagerImpl$DeltaAwareList@108d6b51}, ImmortalCacheEntry{key=IntermediateCompositeKey [taskId=88948a8b-2a8a-4c13-bc45-4dc3a9f6b0fb, key=cool], value=org.infinispan.distexec.mapreduce.MapReduceManagerImpl$DeltaAwareList@77949e8f}, ImmortalCacheEntry{key=IntermediateCompositeKey [taskId=88948a8b-2a8a-4c13-bc45-4dc3a9f6b0fb, key=Infinispan], value=org.infinispan.distexec.mapreduce.MapReduceManagerImpl$DeltaAwareList@712a6071}, ImmortalCacheEntry{key=IntermediateCompositeKey [taskId=88948a8b-2a8a-4c13-bc45-4dc3a9f6b0fb, key=community], value=org.infinispan.distexec.mapreduce.MapReduceManagerImpl$DeltaAwareList@291bdf76}] expected:<0> but was:<5>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at org.infinispan.distexec.mapreduce.DistributedSharedCacheTwoNodesMapReduceTest.invokeMapReduce(DistributedSharedCacheTwoNodesMapReduceTest.java:44)
> at org.infinispan.distexec.mapreduce.BaseWordCountMapReduceTest.testInvokeMapReduceOnAllKeys(BaseWordCountMapReduceTest.java:161)
> 04:06:32,579 TRACE (transport-thread-NodeA-p29577-t6:) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=IntermediateCompositeKey [taskId=eb7da48a-5922-4671-9037-4077e209744c, key=RedHat], value=null, flags=null, valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@c0bbc61]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-8166) Writes via memcached server cause UnknownOperationException
by Tristan Tarrant (JIRA)
Tristan Tarrant created ISPN-8166:
-------------------------------------
Summary: Writes via memcached server cause UnknownOperationException
Key: ISPN-8166
URL: https://issues.jboss.org/browse/ISPN-8166
Project: Infinispan
Issue Type: Bug
Components: Server
Affects Versions: 8.2.6.Final, 9.0.1.Final, 9.1.0.Final
Environment: Ubuntu 16.04.1 LTS
openjdk version "1.8.0_91"
OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-3ubuntu1~16.04.1-b14)
OpenJDK 64-Bit Server VM (build 25.91-b14, mixed mode)
The bug can be reproduced with OS X and other Linux distributions as well
Reporter: Wolfram Huesken
Assignee: Tristan Tarrant
Fix For: 9.0.4.Final, 9.1.1.Final, 8.2.9.Final
We're using the stable server version (http://infinispan.org/download/) as a memcached replacement in a PHP application. When we're writing keys (or values) with different sizes via memcached, we encounter the following exception:
{{17:14:42,531 ERROR [org.infinispan.server.memcached.RequestResolver$] (MemcachedServerWorker-8-1) ISPN005003: Exception reported: org.infinispan.server.memcached.UnknownOperationException: Unknown operation: }}
When the exception occurs, the data is not stored.
We're currently closing and reopening the connection after an error like that occurred, but it's slowing down the data transfer quite a lot.
The bug is not only related to the server, but happens with the embedded version of infinispan, too.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months
[JBoss JIRA] (ISPN-7086) Writes via memcached server cause UnknownOperationException
by Tristan Tarrant (JIRA)
[ https://issues.jboss.org/browse/ISPN-7086?page=com.atlassian.jira.plugin.... ]
Tristan Tarrant updated ISPN-7086:
----------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
> Writes via memcached server cause UnknownOperationException
> -----------------------------------------------------------
>
> Key: ISPN-7086
> URL: https://issues.jboss.org/browse/ISPN-7086
> Project: Infinispan
> Issue Type: Bug
> Components: Server
> Affects Versions: 8.2.6.Final, 9.0.1.Final, 9.1.0.Final
> Environment: Ubuntu 16.04.1 LTS
> openjdk version "1.8.0_91"
> OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-3ubuntu1~16.04.1-b14)
> OpenJDK 64-Bit Server VM (build 25.91-b14, mixed mode)
> The bug can be reproduced with OS X and other Linux distributions as well
> Reporter: Wolfram Huesken
> Assignee: Tristan Tarrant
> Labels: memcached
> Fix For: 9.0.4.Final, 9.1.1.Final, 8.2.9.Final
>
>
> We're using the stable server version (http://infinispan.org/download/) as a memcached replacement in a PHP application. When we're writing keys (or values) with different sizes via memcached, we encounter the following exception:
> {{17:14:42,531 ERROR [org.infinispan.server.memcached.RequestResolver$] (MemcachedServerWorker-8-1) ISPN005003: Exception reported: org.infinispan.server.memcached.UnknownOperationException: Unknown operation: }}
> When the exception occurs, the data is not stored.
> We're currently closing and reopening the connection after an error like that occurred, but it's slowing down the data transfer quite a lot.
> The bug is not only related to the server, but happens with the embedded version of infinispan, too.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
7 years, 4 months