[infinispan-dev] Parallel M/R

Vladimir Blagojevic vblagoje at redhat.com
Fri Dec 6 11:52:19 EST 2013


Hey Mircea,

On 12/6/2013, 11:40 AM, Mircea Markus wrote:
> Ah right. Still for each key an StatelessTask instance is created though. 

I don't think this is the case. There is one StatelessTask per 
map/reduce/combine invocation.

>> What I intend to do is move this code to DataContainer because the
>> minimal overhead of directly iterating keys inside container and
>> iterating in parallel should gives a further edge.
> Hmm I think you could leverage the parallel iteration from the EquivalentConcurrentHashMapV8 there instead of writing it yourself ;)
>

Yeah, I have to look that up. I kinda missed the whole evolution of 
ConcurrentHashMapV8.

Vladimir


More information about the infinispan-dev mailing list