[infinispan-issues] [JBoss JIRA] (ISPN-4002) Allow the reduce phase to store elements into an intermediate cache
Vladimir Blagojevic (JIRA)
issues at jboss.org
Tue Feb 25 09:59:48 EST 2014
[ https://issues.jboss.org/browse/ISPN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12947904#comment-12947904 ]
Vladimir Blagojevic commented on ISPN-4002:
-------------------------------------------
Yes, [~dan.berindei] intermediate confuses users with our temp/intermediate caches used between map/reduce phases. I'll update it
> Allow the reduce phase to store elements into an intermediate cache
> --------------------------------------------------------------------
>
> Key: ISPN-4002
> URL: https://issues.jboss.org/browse/ISPN-4002
> Project: Infinispan
> Issue Type: Feature Request
> Components: Core, Distributed Execution and Map/Reduce
> Reporter: Mircea Markus
> Assignee: Vladimir Blagojevic
>
> In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
> - have a result cache
> - put all the M/R entries into this result cache
> It should be possible to specify this cache to the Map/Reduce task to be executed (cache name), as users might reuse the cache and configure it externally.
>
> The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
More information about the infinispan-issues
mailing list