On 08/26/2009 05:48 PM, Mircea Markus wrote: > Can't we write a plugin for the CacheBenchmark fwk? We could potentially do so but we'd be missing loads of things and we'd have to spend a fair bit of time replicating the way Hibernate uses the cache which is not straightforward by any means. Take in account as well that there're several caches and cache usages involved here: entity, collection, query and timestamps and each has a different usage pattern. Bottom line: I don't think trying to emulate this is worth the effort. What is needed here is a Hibernate/JPA load/perf test environment where the most common Hibernate usage patterns are exercised and then you swap 2nd level cache providers. This is really what counts to the users: how quickly I can persist N entities, how quick I can read N times an entity that I've just persisted, how fast I can execute same query N times...etc, these are the use cases where the cache provider must show off. I haven't heard anything from the HB team wrt to this, so I assume they don't have anything like this. > > On Aug 19, 2009, at 1:14 PM, Galder Zamarreno wrote: > >> While talking to Manik online, the topic of 2nd level cache benchmarking >> came up and was wondering if there's a way to benchmark different 2nd >> level cache providers in Hibernate? >> >> Cheers, >> -- >> Galder Zamarreño >> Sr. Software Engineer >> Infinispan, JBoss Cache >> _______________________________________________ >> infinispan-dev mailing list >> infinispan-dev(a)lists.jboss.org >> https://lists.jboss.org/mailman/listinfo/infinispan-dev > -- Galder Zamarreño Sr. Software Engineer Infinispan, JBoss Cache _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev

The best bet for something like this is a separate project which pulls in the proper hibernate dependencies. Then we can talk with Juca about getting them set up on a scheduled run. However, if you want to have the configuration varied for different runs, I suggest you wait until after the discussions with the Maven developers to address the numerous specific issues we have encountered with Maven. This is exactly one of the issues "on the docket". We have issues with this "varied config" piece in the core/testsuite module. On Wed, 2009-09-02 at 06:20 -0500, Sanne Grinovero wrote: > Totally agree with this, it would be useful also to benchmark other > parts of Hibernate (not just the cache) > and as general regression test. > Also with Hibernate Search I have some "private tests" which are very > time consuming (an hour or so) which I can't > commit on trunk as unit tests; I'd like to have them somewhere, maybe > regularly executed by Continuous Integration > (too much work for existing Hudson?). > > Sanne > > 2009/9/1 Galder Zamarreno <galder.zamarreno(a)redhat.com&gt;: >> >> >> On 08/26/2009 05:48 PM, Mircea Markus wrote: >>> Can't we write a plugin for the CacheBenchmark fwk? >> >> We could potentially do so but we'd be missing loads of things and >> we'd >> have to spend a fair bit of time replicating the way Hibernate >> uses the >> cache which is not straightforward by any means. Take in account >> as well >> that there're several caches and cache usages involved here: entity, >> collection, query and timestamps and each has a different usage >> pattern. >> Bottom line: I don't think trying to emulate this is worth the >> effort. >> >> What is needed here is a Hibernate/JPA load/perf test environment >> where >> the most common Hibernate usage patterns are exercised and then >> you swap >> 2nd level cache providers. This is really what counts to the >> users: how >> quickly I can persist N entities, how quick I can read N times an >> entity >> that I've just persisted, how fast I can execute same query N >> times...etc, these are the use cases where the cache provider must >> show off. >> >> I haven't heard anything from the HB team wrt to this, so I assume >> they >> don't have anything like this. >> >>> >>> On Aug 19, 2009, at 1:14 PM, Galder Zamarreno wrote: >>> >>>> While talking to Manik online, the topic of 2nd level cache >>>> benchmarking >>>> came up and was wondering if there's a way to benchmark >>>> different 2nd >>>> level cache providers in Hibernate? >>>> >>>> Cheers, >>>> -- >>>> Galder Zamarreño >>>> Sr. Software Engineer >>>> Infinispan, JBoss Cache >>>> _______________________________________________ >>>> infinispan-dev mailing list >>>> infinispan-dev(a)lists.jboss.org >>>> https://lists.jboss.org/mailman/listinfo/infinispan-dev >>> >> >> -- >> Galder Zamarreño >> Sr. Software Engineer >> Infinispan, JBoss Cache >> _______________________________________________ >> infinispan-dev mailing list >> infinispan-dev(a)lists.jboss.org >> https://lists.jboss.org/mailman/listinfo/infinispan-dev >> > > _______________________________________________ > hibernate-dev mailing list > hibernate-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/hibernate-dev -- Steve Ebersole <steve(a)hibernate.org&gt; Hibernate.org _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev