[infinispan-dev] HDFS FileStore

[Cristian Malinescu]

Hi Gustavo - thanks for the guidance!
Have some questions -
1. ISPN-2940 <https://issues.jboss.org/browse/ISPN-2940> - says the idea
isn't new and it didn't got a 'Go' at that moment. If we proceed with this
work, does it mean a reopening of the item?
2. Couldn't see any design docs for both SingleFile and SoftIndexFile
store(s) subsystems - fairly, couldn't find design docs for any of the
pluggable
     cache store modules. I want to start from one of them to keep
consistency and compatibility in style for easiness of adoption.
3. Was the HDFS store idea abandoned because just using HBase would pretty
much offer the same with the advantage of offloading on HBase the need
    for compaction due to the append-only nature of HDFS?

Cheers
Cris

On Thu, May 12, 2016 at 10:52 AM, Gustavo Fernandes <gustavo at infinispan.org>
wrote:

> Hi Cristian!
>
> A HDFS cache store [1] looks interesting, and given the append-only nature
> of HDFS, I'd say probably the SoftIndex is better to look at than the
> SingleFile store since it employs some techniques of append only plus
> eventual compactations.
> It'd be interesting to have a design document so that we can have a
> starting point; we usually publish such designs at [2].
>
> Cheers,
> Gustavo
>
> [1] https://issues.jboss.org/browse/ISPN-2940
> [2] https://github.com/infinispan/infinispan/wiki
>
> On Thu, May 12, 2016 at 2:26 PM, Cristian Malinescu <
> cristian.malinescu at gmail.com> wrote:
>
>> Hello folks - I would like to implement for my own project a custom cache
>> store for Infinispan using HDFS and using as base line one of the already
>> implemented file stores - SoftIndex and SingleFile.
>> I thought it would be beneficiary if I start and do it directly as
>> contribution to the Infinispan code base, is someone interested to take on
>> this subject and we start brainstorming about how should this task being
>> approached to be sure it gets done smooth, accordingly to the project's
>> community house rules so we don't encounter hassle at the point when we can
>> look at merging in the baseline, avoid potentially double work for same
>> feature etc.
>>
>> Kind regards
>> Cristian Malinescu
>>
>> https://github.com/Cristian-Malinescu
>> https://www.linkedin.com/in/cristianmalinescu
>>
>>
>> P.S I went already trough
>> http://infinispan.org/docs/8.2.x/contributing/contributing.html
>> so theoretically I can just start and place a pull request on GitHub but
>> I wanted to be sure you guys are also aware of this plan so we keep in sync
>> and all opinions are taken in consideration and addressed.
>>
>> _______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>>
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20160513/fa8514d1/attachment.html