9:52 a.m.
Hi,
as we've discovered some imperfections in current distributed index
implementation, I'd like to know whether it could be possible to store
on each node only index of those entries that are primary-owned on that
node. Then, each query would be broadcast to other nodes and the results
would be merged.
From what I understood from Coherence documentation, they do that this
way - this seems quite reasonable to me, and does not introduce any
bottleneck as our index-master node (and also it does not require any
synchronization on shared index). It's also different from sharding
which introduces multiple indices but shares the index across nodes.
I can easily imagine simple ... WHERE x = 'y' queries, ORDER BY or
projections wouldn't be complicated either (unless sorting by
non-projected field). Effective offsets and limits would require a bit
more work, but the simplistic implementation (non-distributed merge)
shouldn't be hard either.
Could this approach be used with Lucene easily, or are there any caveats?
Radim
--
Radim Vansa <rvansa(a)redhat.com>
JBoss DataGrid QA
10:28 a.m.
On Mon, Aug 25, 2014 at 8:52 AM, Radim Vansa <rvansa(a)redhat.com> wrote:
Hi,
as we've discovered some imperfections in current distributed index
implementation, I'd like to know whether it could be possible to store
on each node only index of those entries that are primary-owned on that
node. Then, each query would be broadcast to other nodes and the results
would be merged.
Hi,
Have you tried the ClusteredQuery feature introduced on [1]?
If you set index = LOCAL in the cache indexing config, only local entries
will be indexed
and then using a ClusteredQuery (see example in [2]), the query is executed
on all all nodes,
results are collected and merged before returning to the caller. Pagination
and Sorting should
be supported as well.
[1] https://issues.jboss.org/browse/ISPN-200
[2]
https://github.com/infinispan/infinispan/blob/master/query/src/test/java/...
Gustavo
Radim
--
Radim Vansa <rvansa(a)redhat.com>
JBoss DataGrid QA
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
11:09 a.m.
Hmm, that sounds like it! I wish I could use DSL for this, too (I have
benchmarks set up only for DSL queries).
According to docs it's experimental feature, although quite old - I
wonder why that was not promoted (it's not covered .
Thanks for the directions
Radim
On 08/25/2014 10:28 AM, Gustavo Fernandes wrote:
On Mon, Aug 25, 2014 at 8:52 AM, Radim Vansa <rvansa(a)redhat.com
<mailto:rvansa@redhat.com>> wrote:
Hi,
as we've discovered some imperfections in current distributed index
implementation, I'd like to know whether it could be possible to store
on each node only index of those entries that are primary-owned on
that
node. Then, each query would be broadcast to other nodes and the
results
would be merged.
Hi,
Have you tried the ClusteredQuery feature introduced on [1]?
If you set index = LOCAL in the cache indexing config, only local
entries will be indexed
and then using a ClusteredQuery (see example in [2]), the query is
executed on all all nodes,
results are collected and merged before returning to the caller.
Pagination and Sorting should
be supported as well.
[1] https://issues.jboss.org/browse/ISPN-200
[2]
https://github.com/infinispan/infinispan/blob/master/query/src/test/java/...
Gustavo
Radim
--
Radim Vansa <rvansa(a)redhat.com <mailto:rvansa@redhat.com>>
JBoss DataGrid QA
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org <mailto:infinispan-dev@lists.jboss.org>
https://lists.jboss.org/mailman/listinfo/infinispan-dev
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
--
Radim Vansa <rvansa(a)redhat.com>
JBoss DataGrid QA
3799
days inactive
3799
days old
infinispan-dev@lists.jboss.org
2 comments
2 participants
participants (2)
-
Gustavo Fernandes -
Radim Vansa