[infinispan-dev] Map/Reduce Tasks and classpath

[Ray Tsang]

Hi Guys,

I also implemented something w/ JSR 223 -
https://github.com/saturnism/infinispan/tree/jsr223-mr/core/src/main/java/org/infinispan/distexec/mapreduce

With tests that uses scripts like this:
https://github.com/saturnism/infinispan/tree/jsr223-mr/core/src/test/resources/mapreduce

On Mon, Jan 28, 2013 at 6:53 AM, Ales Justin <ales.justin at gmail.com> wrote:

> > M/R classes do have access to the cache so they can get a hold of the
> app's class loader.  But the tricky part is that the M/R tasks themselves
> need to be loaded from that class loader first…
>
> This already seems to work -- as we use tasks extensively in CapeDwarf,
> and it seems to work OK; note: CapeDwarf runs in both ways - modular and
> embedded
>
> -Ales
>
> > On 28 Jan 2013, at 14:01, Ales Justin <ales.justin at gmail.com> wrote:
> >
> >>> Ales - how could we bundle something like this as an AS module and
> play nice with modular class loading there?
> >>
> >> Well, I would say we're back to that discussion with
> AdvancedCache::withClassloader. :-)
> >> Same thing with M/R -- can it tap into app's CL?
> >> Otherwise TCCL should do, in JEE env.
> >>
> >> Or perhaps some init(Cache cache) on M/R classes, where it can get a
> hold of Cache,
> >> which would then expose app' CL, via AC::withClassloader?
> >>
> >> -Ales
> >>
> >>> On 26 Jan 2013, at 21:55, Ales Justin <ales.justin at gmail.com> wrote:
> >>>
> >>>>> Would the thread context classloader be the right thing to use?
> >>>>
> >>>> It depends how Infinispan's M/R code handles setting of TCCL.
> >>>> Specially in remote invocations.
> >>>> But I would expect it to work.
> >>>> Not the best, but good enough. :-)
> >>>>
> >>>>> Or, perhaps it can use ScriptEngine?
> >>>>
> >>>> What's ScriptEngine?
> >>>>
> >>>> -Ales
> >>>>
> >>>> _______________________________________________
> >>>> infinispan-dev mailing list
> >>>> infinispan-dev at lists.jboss.org
> >>>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> >>>
> >>> --
> >>> Manik Surtani
> >>> manik at jboss.org
> >>> twitter.com/maniksurtani
> >>>
> >>> Platform Architect, JBoss Data Grid
> >>> http://red.ht/data-grid
> >>>
> >>>
> >>> _______________________________________________
> >>> infinispan-dev mailing list
> >>> infinispan-dev at lists.jboss.org
> >>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> >>
> >>
> >> _______________________________________________
> >> infinispan-dev mailing list
> >> infinispan-dev at lists.jboss.org
> >> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> >
> > --
> > Manik Surtani
> > manik at jboss.org
> > twitter.com/maniksurtani
> >
> > Platform Architect, JBoss Data Grid
> > http://red.ht/data-grid
> >
> >
> > _______________________________________________
> > infinispan-dev mailing list
> > infinispan-dev at lists.jboss.org
> > https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20130128/584c3ec2/attachment.html