[JBoss JIRA] (ISPN-4002) Allow the reduce phase to store elements into an intermediate cache
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-4002?page=com.atlassian.jira.plugin.... ]
Dan Berindei commented on ISPN-4002:
------------------------------------
[~mircea.markus] [~vblagojevic] I suppose this is about specifying a results cache, not an intermediary cache?
> Allow the reduce phase to store elements into an intermediate cache
> --------------------------------------------------------------------
>
> Key: ISPN-4002
> URL: https://issues.jboss.org/browse/ISPN-4002
> Project: Infinispan
> Issue Type: Feature Request
> Components: Core, Distributed Execution and Map/Reduce
> Reporter: Mircea Markus
> Assignee: Vladimir Blagojevic
>
> In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
> - have a result cache
> - put all the M/R entries into this result cache
> It should be possible to specify this cache to the Map/Reduce task to be executed (cache name), as users might reuse the cache and configure it externally.
>
> The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 11 months
[JBoss JIRA] (ISPN-2686) Enhance Mapper API with lazy loaded value
by Vladimir Blagojevic (JIRA)
[ https://issues.jboss.org/browse/ISPN-2686?page=com.atlassian.jira.plugin.... ]
Vladimir Blagojevic commented on ISPN-2686:
-------------------------------------------
This requires API changes - use of a new mapper interface. I'd say lets leave it and see if more people request something like this. I would rather not complicate things further unless it is really necessary.
> Enhance Mapper API with lazy loaded value
> -----------------------------------------
>
> Key: ISPN-2686
> URL: https://issues.jboss.org/browse/ISPN-2686
> Project: Infinispan
> Issue Type: Enhancement
> Components: Distributed Execution and Map/Reduce
> Affects Versions: 5.2.0.Beta6
> Reporter: Thomas Fromm
> Assignee: Vladimir Blagojevic
> Priority: Minor
>
> In situations where Map/Reduce is used and the value is not (always) needed at the Mapper, the value could be loaded lazy, when the map(..) interface is slightly changed:
> map(Entry<KIn, VIn> entry, Collector<Entry<KIn, VIn>> collector)
> When entry.getValue() is called, the value should be loaded from store or maybe remote node.
> Maybe this change to Entry would be also useful for event api ISPN-1802
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 11 months
[JBoss JIRA] (ISPN-3899) XAResourceRecovery implementation needed for transaction recovery in library mode
by Mircea Markus (JIRA)
[ https://issues.jboss.org/browse/ISPN-3899?page=com.atlassian.jira.plugin.... ]
Mircea Markus commented on ISPN-3899:
-------------------------------------
[~jmarkos] I think the XAResource that you need to register with TM's XAResourceRecoveryRegistry is the one that can be obtained through: cache.getAdvancedCache().getXAResource(). Paul, any idea why that wouldn't work?
> XAResourceRecovery implementation needed for transaction recovery in library mode
> ---------------------------------------------------------------------------------
>
> Key: ISPN-3899
> URL: https://issues.jboss.org/browse/ISPN-3899
> Project: Infinispan
> Issue Type: Bug
> Components: Transactions
> Reporter: Galder Zamarreño
> Assignee: Ion Savin
> Fix For: 7.0.0.Final
>
>
> According to [~pferraro], an implementation of XAResourceRecovery needs to be added to Infinispan and plugged into XAResourceRecoveryRegistry in order to get recovery of XA transactions working as expected.
> This is already done in Server/AS/Wildfly in org.jboss.as.clustering.infinispan.subsystem.CacheService class.
> A similar thing should happen when Infinispan is used in embedded/library mode.
> [~isavin], since you are going to work on the transaction changes in 7.0, maybe you can take this on too? It'd be interesting to add a test to start with which shows that XA transaction recovery is not working as expected as a result of not having this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 11 months