[infinispan-dev] Infinspan configuration Distributed Node with distributed index and HotRod usage

[Guillaume terral]

Hello Galder,

We are not limited to put/get calls, we are using complex remote queries to
retrieve specific subset of data (sort by date, containing field = %test%),
this kind of request.

We use protobuf to serialize/ deserialize data into the infinispan cache.

I will try to disable transaction and give you some information on what
happend.

Thanks

Guillaume


2014-03-26 11:26 GMT+01:00 Galder Zamarreño <galder at redhat.com>:

> Hi Guillaume,
>
> I'm looking at your project and not sure I understand what you are trying
> to do.
>
> If your queries are limited to put/get calls, indexing the contents in the
> Hot Rod server is probably pointless because it just stores binary data,
> unless you have remote querying enabled, in which it uses protobuf stuff to
> index data (Adrian Nistor can provide more details). Unless you are doing
> remote querying (
> http://infinispan.org/docs/6.0.x/user_guide/user_guide.html#_querying_via_the_java_hot_rod_client)
> with complex queries, I'd disable any indexing.
>
> In either case, Hot Rod protocol is non transactional, so normally i'd
> start disabling transactions. Now, without transactions, if there's some
> lag, you should inspect the usual suspects: GC logs, thread dumps,...etc and
> see whether anything pops up.
>
> Cheers,
>
> On 17 Mar 2014, at 11:45, Guillaume terral <guillaume.terral at gmail.com>
> wrote:
>
> > Hello Infinispan Dev Team,
> >
> >
> >
> > After several days of testing and research with Sanne Grinovero, he
> asked me to send an email to this mailing list to expose you my issue with
> Infinispan.
> >
> >
> > I'm actually working on a project to build an infinispan cluster with
> the following requirement:
> >
> >
> > - Clustered nodes in Distributed mode
> >
> > - Usage of HotRod to send and query data from the cluster
> >
> > - Low latency for read and write
> >
> > - Distributed lucene index
> >
> > - JGroups back-end
> >
> >
> > I posted the configuration i have for my cluster and for the hot rod
> client on a github under:
> >
> >
> > https://github.com/guillaumeterral/infinispan-test
> >
> >
> > You will see a little readme explaining how to use this java project.
> >
> >
> > I faced some issues along my development,
> >
> >
> > What i noticed is:
> >
> >
> > If i remove the line
> .transaction().transactionMode(TransactionMode.NON_TRANSACTIONAL), I have
> good latencies showed in the statistics MBean for averageWritingTime but I
> get an unstable cluster with the following issues:
> >
> >
> >
> > - lock issue, one node lock the index and try to write in it, at the
> same time another node is trying to lock the index, this behavior lead to a
> lock timeout.
> >
> > - send message timeout, some node timeout to send message to others, i
> was not able to understand the root code.
> >
> > - compound file not found, this appears only if I use compound file
> (default behavior) I think those errors are due to previous ones.
> >
> >
> > But with a non transactional cluster i get a pretty stable cluster but
> with really bad latencies (~ 1.5s) showed in the cluster and in the GUI
> client i wrote, this client is not present of GitHub I can push a console
> client on demand if you want.
> >
> >
> > We tried to investigate the issue with Sanne, but across IRC it's not
> that easy.
> >
> >
> > Could you provide me some help/advice, we are really motivated to use
> Infinispan and to give you some feedback on it, especially the HotRod
> client/server component.
> >
> >
> > We plan to test Infinispan 7.0 and provide you some feedback when we
> will complete our requirements on Infinispan 6.0 cluster.
> >
> >
> > You can join me at this mail adress at any time, or contact me on IRC
> (#infinispan) my nickname is guillaume__ , i'm almost always connected on
> it.
> >
> >
> > Thanks in advance,
> >
> >
> >
> > Guillaume
> >
> >
> >
> > _______________________________________________
> > infinispan-dev mailing list
> > infinispan-dev at lists.jboss.org
> > https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
>
> --
> Galder Zamarreño
> galder at redhat.com
> twitter.com/galderz
>
> Project Lead, Escalante
> http://escalante.io
>
> Engineer, Infinispan
> http://infinispan.org
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20140326/e6c66f53/attachment-0001.html