[infinispan-dev] New draft for distributed execution framework
Vladimir Blagojevic
vblagoje at redhat.com
Wed Dec 1 08:05:37 EST 2010
On 10-12-01 8:07 AM, Manik Surtani wrote:
> No, in terms of which tasks are executed 'locally' and which tasks are executed 'remotely'.
>
> E.g., there are concievably 3 types of tasks:
>
> 1) Tasks that are data intensive, that should be executed on a remote node, close to the actual data
> 2) Aggregation of results of these data intensive tasks, which should happen on remote nodes as well, before transmitting any results back to the caller
> 3) Aggregation of several results on the caller.
>
> Now each of these tasks can be chained - I think there definitely is value in that.
Their specifics are determined as they are added to "coordinated task",
I am sure we can tune this to requirements we need.
|CacheManager cm = ...;
CoordinatedTask task = cm.newCoordinatedTask("finalOutcomeCacheName");
cm.addLocalTask(*new* GridFileQuery("my_gridfs"));// Fetch
cm.addLocalTask(*new* GridFileSizeCounter());// Map
cm.addGlobalTask(*new* IntegerSummarizer("my_gridfs_size");// Reduce|
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20101201/486a330f/attachment.html
More information about the infinispan-dev
mailing list