Re: [infinispan-dev] grouping and GridFS
On 5 March 2014 14:54, Ales Justin <ales.justin(a)gmail.com> wrote:
Why do you chunk at all if you want them stored together?
I only use chunking if I can't avoid it, to spread large files.
That's what's GridFS all about -- store very large files.
Hence chunking.
So you're saying we should know the limit of what we can store on 1 node,
if bigger, spread, therefore no grouping.
Yes, but a very conservative approximation would be good enough: you
don't need hardware specifications to figure out a reasonable
threshold.
If I had to make up a number out of thin air, I'd pick something
around 10MB: any file below that threshold would not use chunking and
be nicely stored together to be retrieved efficiently; beyond that
start distributing.
(this figure could probably use some testing if you're looking into performance)
Sanne
-Ales
On 5 Mar 2014 11:22, "Ales Justin" <ales.justin(a)gmail.com> wrote:
>
> Just having a discussion with Bela about this.
>
> I guess having "grouping" on GridFS' content would make sense.
> e.g. put all chunks on the same node
>
> Is this doable?
> Afaiu, we would need to have some sort of "similarity" function for
> content's metadata?
>
> -Ales
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev(a)lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev