[JBoss JIRA] (ISPN-3999) Invoke reducer immediatelly as intermediate VOut values are being collected
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-3999?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-3999:
-------------------------------
Assignee: (was: Vladimir Blagojevic)
> Invoke reducer immediatelly as intermediate VOut values are being collected
> ---------------------------------------------------------------------------
>
> Key: ISPN-3999
> URL: https://issues.jboss.org/browse/ISPN-3999
> Project: Infinispan
> Issue Type: Enhancement
> Reporter: Vladimir Blagojevic
> Priority: Minor
>
> Currently in intermediate phase [1] as values for every KOut are being collected/grouped in the cluster we simply add every VOut to the list of values keyed by KOut. In reducer phase we then send a reducer function that gets invoked on List<VOut> and reduces those values into single VOut. However, this could be suboptimal as we can invoke reducer function as every VOut gets grouped rather than wait for all VOut values to be collected and then invoke reducers. However, reduce function could potentially take a lot of time to execute even for one value thus causing prolonged locking and congestions. We should implement this enhancement and do thorough performance measurements. This feature should be have an API setting in MapReduceTask.
> Sanne Grinovero gets the credit for this idea.
> [1] http://blog.infinispan.org/2012/07/mapreduce-improvements-in-infinispan.html
--
This message was sent by Atlassian JIRA
(v6.3.8#6338)
10 years, 1 month
[JBoss JIRA] (ISPN-4144) Cleanly shutdown intermediate M/R cache
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-4144?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-4144:
-------------------------------
Assignee: Dan Berindei (was: Vladimir Blagojevic)
> Cleanly shutdown intermediate M/R cache
> ---------------------------------------
>
> Key: ISPN-4144
> URL: https://issues.jboss.org/browse/ISPN-4144
> Project: Infinispan
> Issue Type: Feature Request
> Reporter: Vladimir Blagojevic
> Assignee: Dan Berindei
>
> For intermediate per task caches we simply remove that cache from cache manager. This operation is cluster wide but it still triggers rebalancing which in turn possibly creates logs that might raise false alarms for admins. Investigate if calling clear before removing cache from cache manager and/or disabling rebalancing for intermediate cache leads to a "cleaner" cache shutdown.
--
This message was sent by Atlassian JIRA
(v6.3.8#6338)
10 years, 1 month
[JBoss JIRA] (ISPN-4312) Distributed(Intermediate)SharedCacheFourNodesMapReduceTest randomly fails on Windows
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-4312?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-4312:
-------------------------------
Assignee: (was: Vladimir Blagojevic)
> Distributed(Intermediate)SharedCacheFourNodesMapReduceTest randomly fails on Windows
> ------------------------------------------------------------------------------------
>
> Key: ISPN-4312
> URL: https://issues.jboss.org/browse/ISPN-4312
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 7.0.0.Alpha4
> Environment: Windows machines, 2k8r2, 2k12r2
> Reporter: Tomas Sykora
> Priority: Blocker
> Labels: testsuite_stability
>
> It looks like tests have problems with fitting into 15 sec timeout on Windows.
> org.infinispan.commons.CacheException: java.util.concurrent.ExecutionException: Reduce phase executing at DistributedSharedCacheFourNodesMapReduceTest-NodeA-36515 did not complete within 15 sec timeout
> at org.infinispan.distexec.mapreduce.MapReduceTask.executeHelper(MapReduceTask.java:498)
> at org.infinispan.distexec.mapreduce.MapReduceTask.execute(MapReduceTask.java:447)
> at org.infinispan.distexec.mapreduce.BaseWordCountMapReduceTest.testInvokeMapReduceOnAllKeysWithResultCache(BaseWordCountMapReduceTest.java:173)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80)
> at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
> at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
> at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
> at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
> at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
> at org.testng.TestRunner.privateRun(TestRunner.java:767)
> at org.testng.TestRunner.run(TestRunner.java:617)
> at org.testng.SuiteRunner.runTest(SuiteRunner.java:334)
> at org.testng.SuiteRunner.access$000(SuiteRunner.java:37)
> at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:368)
> at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.ExecutionException: Reduce phase executing at DistributedSharedCacheFourNodesMapReduceTest-NodeA-36515 did not complete within 15 sec timeout
> at org.infinispan.distexec.mapreduce.MapReduceTask.executeReducePhase(MapReduceTask.java:748)
> at org.infinispan.distexec.mapreduce.MapReduceTask.executeHelper(MapReduceTask.java:495)
> ... 23 more
> Caused by: org.infinispan.util.concurrent.TimeoutException: Node DistributedSharedCacheFourNodesMapReduceTest-NodeD-54406 timed out
> at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommand(CommandAwareRpcDispatcher.java:174)
> at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:521)
> at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:280)
> at org.infinispan.remoting.rpc.RpcManagerImpl$2.call(RpcManagerImpl.java:312)
> ... 5 more
> Caused by: org.jgroups.TimeoutException: timeout sending message to DistributedSharedCacheFourNodesMapReduceTest-NodeD-54406
> at org.jgroups.blocks.MessageDispatcher.sendMessage(MessageDispatcher.java:419)
> at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processSingleCall(CommandAwareRpcDispatcher.java:349)
> at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommand(CommandAwareRpcDispatcher.java:167)
> ... 8 more
--
This message was sent by Atlassian JIRA
(v6.3.8#6338)
10 years, 1 month
[JBoss JIRA] (ISPN-5033) Lack of EmbeddedCacheManager.undefineConfiguration(String) can cause memory/classloader leaks
by Tristan Tarrant (JIRA)
[ https://issues.jboss.org/browse/ISPN-5033?page=com.atlassian.jira.plugin.... ]
Tristan Tarrant reassigned ISPN-5033:
-------------------------------------
Assignee: Tristan Tarrant
> Lack of EmbeddedCacheManager.undefineConfiguration(String) can cause memory/classloader leaks
> ---------------------------------------------------------------------------------------------
>
> Key: ISPN-5033
> URL: https://issues.jboss.org/browse/ISPN-5033
> Project: Infinispan
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 7.1.0.Alpha1
> Reporter: Paul Ferraro
> Assignee: Tristan Tarrant
>
> EmbeddedCacheManager has defineConfiguration(...) methods for defining a new cache configuration, but has no equivalent "undefine" method. Consequently, once defined, a cache manager will retains a reference to the cache configuration object for the lifetime of the cache manager. While this is normally not a big deal, the configuration objects generated by WildFly contain references to the classloaders of foreign modules.
--
This message was sent by Atlassian JIRA
(v6.3.8#6338)
10 years, 1 month
[JBoss JIRA] (ISPN-5033) Lack of EmbeddedCacheManager.undefineConfiguration(String) can cause memory/classloader leaks
by Tristan Tarrant (JIRA)
[ https://issues.jboss.org/browse/ISPN-5033?page=com.atlassian.jira.plugin.... ]
Tristan Tarrant updated ISPN-5033:
----------------------------------
Status: Open (was: New)
> Lack of EmbeddedCacheManager.undefineConfiguration(String) can cause memory/classloader leaks
> ---------------------------------------------------------------------------------------------
>
> Key: ISPN-5033
> URL: https://issues.jboss.org/browse/ISPN-5033
> Project: Infinispan
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 7.1.0.Alpha1
> Reporter: Paul Ferraro
> Assignee: Tristan Tarrant
>
> EmbeddedCacheManager has defineConfiguration(...) methods for defining a new cache configuration, but has no equivalent "undefine" method. Consequently, once defined, a cache manager will retains a reference to the cache configuration object for the lifetime of the cache manager. While this is normally not a big deal, the configuration objects generated by WildFly contain references to the classloaders of foreign modules.
--
This message was sent by Atlassian JIRA
(v6.3.8#6338)
10 years, 1 month