[infinispan-dev] Parallel M/R
Vladimir Blagojevic
vblagoje at redhat.com
Fri Dec 6 11:52:19 EST 2013
Hey Mircea,
On 12/6/2013, 11:40 AM, Mircea Markus wrote:
> Ah right. Still for each key an StatelessTask instance is created though.
I don't think this is the case. There is one StatelessTask per
map/reduce/combine invocation.
>> What I intend to do is move this code to DataContainer because the
>> minimal overhead of directly iterating keys inside container and
>> iterating in parallel should gives a further edge.
> Hmm I think you could leverage the parallel iteration from the EquivalentConcurrentHashMapV8 there instead of writing it yourself ;)
>
Yeah, I have to look that up. I kinda missed the whole evolution of
ConcurrentHashMapV8.
Vladimir
More information about the infinispan-dev
mailing list