[infinispan-dev] Event log

[Sanne Grinovero]

The Hibernate Search project is now working on giving end users the
option to write to either
 - Lucene (embedded/local and optionally into Infinispan's Lucene Directory)
 - Elastic Search -> would give you ELK integration
 - [later] Solr

We have a working prototype, and just yesterday some of the first
steps were merged in master.

This implies that if you write those events into an ad-hoc Infinispan
Cache, you inherit the functionality via Infinispan Query and benefit
from the decoupling and pluggability of our indexing components via a
stable API.

I'd suggest you just write those events into a dedicated Cache; you
could index the cache by default and I'm happy to help defining an
appropriate "domain model" to record such events..
Clearly indexing such a cache has benefits, but assuming you don't
need some Lucene-only statistics you'd have the option for non-indexed
queries and in the near future for ELK connectors.

Sanne


On 13 November 2015 at 13:32, Sebastian Laskawiec <slaskawi at redhat.com> wrote:
> I really like the idea!
>
> Would it be possible to forward raw data (not aggregated) to the ELK stack
> [1]?
> This aspect might be important for production systems with centralized
> logging.
>
> [1] http://wildfly.org/news/2015/07/25/Wildfly-And-ELK/
>
> On Fri, Nov 13, 2015 at 1:57 PM, Tristan Tarrant <ttarrant at redhat.com>
> wrote:
>>
>> Hi guys,
>>
>> in order to keep track of notable events (nodes joining, leaving,
>> rebalances, availability, task execution) and present them in the
>> console I was thinking of using specific logging categories. These logs
>> would be then collected by dedicated appenders on each node. The idea
>> would then be to have some distexec tasks exposed to the management
>> interface (console/CLI) which can query and aggregate the data.
>> Initially I was thinking about using a local cache per-node with a SFCS,
>> eviction, expiration and indexing and creating a log4j appender which
>> writes to this cache, but probably a simpler lucene-based appender would
>> suffice.
>>
>> WDYT ?
>>
>> Tristan
>> --
>> Tristan Tarrant
>> Infinispan Lead
>> JBoss, a division of Red Hat
>> _______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev