[infinispan-dev] ISPN 200

[Manik Surtani]

How about something like:

- Broadcast the query
- Every node creates the QueryHits inst, runs the query and collects results.  Starts streaming the results back immediately.
- The lazy iterator returns to the user immediately, and maintains an internal cache of results coming in from N remote QueryHits instances
- iterator.next() blocks until this cache has available entries to return.
- on an implementation level, the GetHItsCommand (or something like that) could return with a single hit, or N hits, with a flag of whether more hits are available or not.

Does that help?

Manik


On 14 Sep 2010, at 20:46, Israel Lacerra wrote:

> Hi guys,
> 
> I'm still thinking about it, but I don't have a really good idea about the lazy iterator yet. The only way (that I see) I could make it more lazily is:
> 
> - Broadcast the query.
> - Every node creates a QueryHits instance with the query and keep it in a simple little cache (array, hash, etc)
> - A "state" of the query is created and every lazyIterator.next() must send a command to a node and get the next hit (the next key).
> - After a certain time, the instances of queryHits "dies".
> 
> It seems to me that this is not too efficient. But I don't have any other ideas.
> 
> Do you have any suggestions about it?
> 
> thanks!
> Israel
> 
> AnyoneOn Tue, Aug 31, 2010 at 9:14 AM, Israel Lacerra <israeldl at gmail.com> wrote:
> Hi Navin,
> 
> I'm trying to do ISPN-200 (https://jira.jboss.org/browse/ISPN-200) and I don't know how to implement a good lazy iterator in a "distributed way".
> 
> (Sorry... my english is not soo good. If you don't understand again, please just ask again!  :)
> 
> 
> Israel
> 
> 
> On Tue, Aug 31, 2010 at 6:27 AM, Navin Surtani <nsurtani at redhat.com> wrote:
> Hi Israel,
> 
> Just a quick question to your issue. What do you mean by you do not have
> the LazyIterator? I suppose I'm not really understanding what your issue
> is. Is it just that you don't want the lazy version or you don't know
> how to use it? :S
> 
> 
> On 25/08/10 14:39, Israel Lacerra wrote:
> > Ok, Manik!
> >
> > I've already have a code working, but not too "lazy" (and without the
> > "sort" part). I get the keys on all nodes, and then I use them. So I
> > have a EagerIterator, but not the LazyIterator. :/
> >
> > I'll think about it...
> >
> > thanks
> >
> > On Wed, Aug 25, 2010 at 10:23 AM, Manik Surtani <manik at jboss.org
> > <mailto:manik at jboss.org>> wrote:
> >
> >
> >     On 24 Aug 2010, at 17:20, Israel Lacerra wrote:
> >
> >      > Manik,
> >      >
> >      > What you mean by:
> >      > "   * The calling node returns a CacheQuery impl that lazily fetches
> >      > and collates results from the cluster." (JIRA)
> >      >
> >      > Is enough if each node returns a list of keys and then, we lazily
> >     get the values using the keys? Or the process has to be more lazy yet?
> >
> >     I think it can be "more lazy" as you said.  :)
> >     --
> >     Manik Surtani
> >     manik at jboss.org <mailto:manik at jboss.org>
> >     Lead, Infinispan
> >     Lead, JBoss Cache
> >     http://www.infinispan.org
> >     http://www.jbosscache.org
> >
> >
> >
> >
> >
> >     _______________________________________________
> >     infinispan-dev mailing list
> >     infinispan-dev at lists.jboss.org <mailto:infinispan-dev at lists.jboss.org>
> >     https://lists.jboss.org/mailman/listinfo/infinispan-dev
> >
> >
> >
> >
> > _______________________________________________
> > infinispan-dev mailing list
> > infinispan-dev at lists.jboss.org
> > https://lists.jboss.org/mailman/listinfo/infinispan-dev
> 
> 
> --
> Navin Surtani
> Intern Infinispan
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> 
> 
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev

--
Manik Surtani
manik at jboss.org
Lead, Infinispan
Lead, JBoss Cache
http://www.infinispan.org
http://www.jbosscache.org




-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20100915/3222feeb/attachment.html