<div dir="ltr">Since I have had some time to think it over I like Pedro's layout, unless someone has a strong objection.<br><br>Responses inline.<br><div><br><div class="gmail_quote"><div dir="ltr">On Mon, Oct 31, 2016 at 4:51 AM Radim Vansa <<a href="mailto:rvansa@redhat.com">rvansa@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 10/27/2016 05:26 PM, William Burns wrote:<br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
> On Thu, Oct 27, 2016 at 9:56 AM Pedro Ruivo <<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a>>> wrote:<br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
> On 27-10-2016 14:20, William Burns wrote:<br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > On Thu, Oct 27, 2016 at 4:56 AM Pedro Ruivo<br class="gmail_msg">
> <<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a> <mailto:<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a>><br class="gmail_msg">
> > <mailto:<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a> <mailto:<a href="mailto:pedro@infinispan.org" class="gmail_msg" target="_blank">pedro@infinispan.org</a>>>> wrote:<br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > On 26-10-2016 23:06, William Burns wrote:<br class="gmail_msg">
> > > I have been working on adding in off heap support for a given<br class="gmail_msg">
> > cache. I<br class="gmail_msg">
> > > wanted to check in and let you all know what I was<br class="gmail_msg">
> thinking for the<br class="gmail_msg">
> > > configuration and changes that would come about with it.<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > TLDR;<br class="gmail_msg">
> > > New config under data container to enable off heap,<br class="gmail_msg">
> StoreAsBinary<br class="gmail_msg">
> > > removed, Equivalence removed<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > First I was planning on adding new sub elements of data<br class="gmail_msg">
> container.<br class="gmail_msg">
> > > These would be instance, binary and off-heap. Only of the<br class="gmail_msg">
> three could<br class="gmail_msg">
> > > be picked as they are mutually exclusive. Instance is as we<br class="gmail_msg">
> > operate now<br class="gmail_msg">
> > > where we store the instance of the object passed to us.<br class="gmail_msg">
> Binary is<br class="gmail_msg">
> > > essentially what we have now that is called storeAsBinary with<br class="gmail_msg">
> > both keys<br class="gmail_msg">
> > > and values converted. Lastly off-heap would store the<br class="gmail_msg">
> entry as a<br class="gmail_msg">
> > byte[]<br class="gmail_msg">
> > > store completely in native memory.<br class="gmail_msg">
> ><br class="gmail_msg">
> > I prefer 'object' instead of 'instance'.<br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > Sounds fine with me.<br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > Are you also planning to remove the expiration and/or eviction<br class="gmail_msg">
> > configuration elements and set them in the data-container<br class="gmail_msg">
> sub elements?<br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > I wasn't planning on touching those. But now that you mention it,<br class="gmail_msg">
> > eviction only makes sense in the data container, where as<br class="gmail_msg">
> expiration is<br class="gmail_msg">
> > container and cache store. And taking this further storeAsBinary is<br class="gmail_msg">
> > both as well, only off-heap is container only. I wonder if<br class="gmail_msg">
> instead we<br class="gmail_msg">
> > should have a separate storage element at the same level as<br class="gmail_msg">
> > data-container. I can see it either way.<br class="gmail_msg">
><br class="gmail_msg">
> Let me know if this makes sense:<br class="gmail_msg">
><br class="gmail_msg">
> <expiration> //no changes here<br class="gmail_msg">
> <memory evictionStrategy=... evictionPolicy=...> <br></blockquote><div><br></div><div>There wouldn't be any elements here. The strategy would always be TinyLFU as this is all Caffeine supports. The thread policy though is interesting, I would say for now don't let it be configured and it will run in the same thead. However Caffeine does have async eviction which we could utilize in the future. But I think we can look into that later and not part of this.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
><br class="gmail_msg">
> //one of the following<br class="gmail_msg">
> <on-heap max-entries=.../><br class="gmail_msg">
> <on-heap-binary max-size=.../><br class="gmail_msg">
> <off-heap ...max-size? and off-heap config.../><br class="gmail_msg"></blockquote><div><br></div><div>I think I like the naming of the elements as OBJECT, BINARY and OFF-HEAP/NATIVE that Radim mentioned.<br><br></div><div>I am thinking for now OBJECT would only support max-entries and the other 2 could support both max-entries or max-size.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
><br class="gmail_msg">
> </memory><br class="gmail_msg">
> <persistence> //no changes here<br class="gmail_msg">
><br class="gmail_msg">
> wdyt?<br class="gmail_msg">
><br class="gmail_msg">
<br class="gmail_msg">
While I prefer "on-heap" instead of "object" or "instance", I don't<br class="gmail_msg">
think that "binary" should be its own element. Are there any attributes<br class="gmail_msg">
specific to that (do you plan to have keys="false" values="true"? I<br class="gmail_msg">
guess not). "on-heap" and "off-heap" is a binary ( :-) ) option,<br class="gmail_msg">
"on-heap-binary" is just a flavour of "on-heap".<br class="gmail_msg"></blockquote><div><br></div><div>Right now the plan is to remove keys and values and always do both. But we may have to change that later, I don't know. Having separate elements gives us more flexibility which I like.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br class="gmail_msg">
For comparison, HC uses<br class="gmail_msg">
<in-memory-format>OBJECT|BINARY|NATIVE</in-memory-format> where "NATIVE"<br class="gmail_msg">
means off-heap. I like "format= OBJECT|BINARY" as a child of on-heap,<br class="gmail_msg">
either as attribute or element. I haven't found similar settings in<br class="gmail_msg">
Coherence - seems that they store data in a serialized form only when<br class="gmail_msg">
they persist to disk/flash or offload to non-managed memory.<br class="gmail_msg"></blockquote><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br class="gmail_msg">
Regarding Equivalence: can't we wrap objects in a similar way we do with<br class="gmail_msg">
byte[] if Equivalance (different from AnyInstance) is defined? I can<br class="gmail_msg">
definitely see use case when the hashCode() is not very well defined and<br class="gmail_msg">
user can't change the class - he has to wrap the objects themselves.<br class="gmail_msg"></blockquote><div><br></div><div>Hrmm we could add that back in if it is really needed. As far as I know though no one has really used this. I would rather make it more minimalistic to begin with and add back on as we find we need features.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br class="gmail_msg">
R.<br class="gmail_msg">
<br class="gmail_msg">
><br class="gmail_msg">
> Seems fine to me. And to be honest I forgot to mention this but<br class="gmail_msg">
> EvictionStrategy and EvictionPolicy are completely redundant now.<br class="gmail_msg">
> Policy has been for a while as we always used the same thread and<br class="gmail_msg">
> Strategy is only Caffeine and for off heap I was thinking of a simple LRU.<br class="gmail_msg">
><br class="gmail_msg">
> This means that the data container element would be removed in favor<br class="gmail_msg">
> of "memory"? The reason being is that equivalence will be gone and<br class="gmail_msg">
> afaik we never really supported a custom data container (eviction<br class="gmail_msg">
> wouldn't work with it and neither would off heap). In that case why<br class="gmail_msg">
> not just keep using data container element?<br class="gmail_msg">
><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > ><br class="gmail_msg">
> > > Example:<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > <data-container><br class="gmail_msg">
> > > <off-heap/><br class="gmail_msg">
> > > </data-container><br class="gmail_msg">
> > ><br class="gmail_msg">
> > > The reason it is a subelement instead of a property is because<br class="gmail_msg">
> > off-heap<br class="gmail_msg">
> > > will most likely require some additional configuration to<br class="gmail_msg">
> tell how<br class="gmail_msg">
> > many<br class="gmail_msg">
> > > entries to store in the a bucket (think non resizing HashMap).<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > With these changes storeAsBinary becomes redundant, so I was<br class="gmail_msg">
> > planning on<br class="gmail_msg">
> > > removing this configuration completely. I would rather<br class="gmail_msg">
> remove since<br class="gmail_msg">
> > > this is 9.0 and not deprecate. As far as I know nobody<br class="gmail_msg">
> really used it<br class="gmail_msg">
> > > before.<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > Also another side effect is I was removing all of the<br class="gmail_msg">
> Equivalence<br class="gmail_msg">
> > > classes. I am not sure if I can plainly remove them since<br class="gmail_msg">
> they have<br class="gmail_msg">
> > > lived in commons for quite a while, but it would be best<br class="gmail_msg">
> if I could,<br class="gmail_msg">
> > > although I am fine deprecating. In its place the instance<br class="gmail_msg">
> setting for<br class="gmail_msg">
> > > data-container will always wrap byte[] to satisfy equals<br class="gmail_msg">
> and hashCode<br class="gmail_msg">
> > > methods.<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > Any feedback would be appreciated.<br class="gmail_msg">
> > ><br class="gmail_msg">
> > > Thanks,<br class="gmail_msg">
> > > - Will<br class="gmail_msg">
> > ><br class="gmail_msg">
> > ><br class="gmail_msg">
> > > _______________________________________________<br class="gmail_msg">
> > > infinispan-dev mailing list<br class="gmail_msg">
> > > <a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>>><br class="gmail_msg">
> > > <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
> > ><br class="gmail_msg">
> > _______________________________________________<br class="gmail_msg">
> > infinispan-dev mailing list<br class="gmail_msg">
> > <a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>>><br class="gmail_msg">
> > <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> ><br class="gmail_msg">
> > _______________________________________________<br class="gmail_msg">
> > infinispan-dev mailing list<br class="gmail_msg">
> > <a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>><br class="gmail_msg">
> > <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
> ><br class="gmail_msg">
> _______________________________________________<br class="gmail_msg">
> infinispan-dev mailing list<br class="gmail_msg">
> <a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a> <mailto:<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a>><br class="gmail_msg">
> <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
> _______________________________________________<br class="gmail_msg">
> infinispan-dev mailing list<br class="gmail_msg">
> <a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
> <a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
<br class="gmail_msg">
<br class="gmail_msg">
--<br class="gmail_msg">
Radim Vansa <<a href="mailto:rvansa@redhat.com" class="gmail_msg" target="_blank">rvansa@redhat.com</a>><br class="gmail_msg">
JBoss Performance Team<br class="gmail_msg">
<br class="gmail_msg">
_______________________________________________<br class="gmail_msg">
infinispan-dev mailing list<br class="gmail_msg">
<a href="mailto:infinispan-dev@lists.jboss.org" class="gmail_msg" target="_blank">infinispan-dev@lists.jboss.org</a><br class="gmail_msg">
<a href="https://lists.jboss.org/mailman/listinfo/infinispan-dev" rel="noreferrer" class="gmail_msg" target="_blank">https://lists.jboss.org/mailman/listinfo/infinispan-dev</a><br class="gmail_msg">
</blockquote></div></div></div>