Guys, WDYT if I move the CacheBenchFwk project from JBoss.org to SF.net? The reason why I think this is a good thing is that it adds a layer of neutrality and unbiasedness to the framework, and allows other cache providers to contribute to and use it. Thoughts? - Manik On 13 Mar 2007, at 16:33, Manik Surtani wrote: > One of the things I want o do before releasing 2.0.0.BETA2 is to > get some idea of performance, with respect to earlier versions of > JBoss Cache. As such, I dug up something I started a couple of > years ago, the CacheBenchFwk, and tidied a few things up. > > If you are interested in this, have a look at: > > http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jboss/CacheBenchFwk/ > > If you have commit rights on JBoss Cache then you'd probably have > the same on this as well. > > In a nutshell, here's what the framework does: > > * Supports multiple cache products/versions/configs > * Allows you to write your own test cases > * Comes with some standard test cases > * Produces simple CSV reports which you can import into your > favourite spreadsheet software and generate graphs > > Here are some of the things I added today: > > * Basic replicated cache support (see docs/Documentation.txt for > details) > > Some of the things I'd like to add: > > * Automated agent-based testing where each node in the cluster is > stressed equally and data is measured on all nodes > * Add throughput to the TestResult class > * Automate the process of starting remote instances based on > configuration settings > > Have a look, let me know your thoughts. I'm sure there are many > areas for improvement, in terms of how the tests are run, reports > generated, etc. As we start testing on bigger and bigger > clusters, such frameworks could be very useful. > > Cheers, > -- > Manik Surtani > > Lead, JBoss Cache > JBoss, a division of Red Hat > > Email: manik(a)jboss.org > Telephone: +44 7786 702 706 > MSN: manik(a)surtani.org > Yahoo/AIM/Skype: maniksurtani > > > _______________________________________________ > jbosscache-dev mailing list > jbosscache-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/jbosscache-dev -- Manik Surtani Lead, JBoss Cache JBoss, a division of Red Hat Email: manik(a)jboss.org Telephone: +44 7786 702 706 MSN: manik(a)surtani.org Yahoo/AIM/Skype: maniksurtani _______________________________________________ jbosscache-dev mailing list jbosscache-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/jbosscache-dev

Hi, Another thing that might be interested to test is the best eviction algorithm to be used in a certain scenario. Given a context(client), an eviction algorithm is 'better' than another one if it manages to return more cached elements, as client ask for them. (any other definitions of 'better' when it comes to eviction policies?) As the benchmark supports multiple configs, it might be useful in helping clients to fine tune their eviction policies. Cheers, Mircea On 3/13/07, Manik Surtani <manik(a)jboss.org&gt; wrote: One of the things I want o do before releasing 2.0.0.BETA2 is to get some idea of performance, with respect to earlier versions of JBoss Cache. As such, I dug up something I started a couple of years ago, the CacheBenchFwk, and tidied a few things up. If you are interested in this, have a look at: http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jboss/ CacheBenchFwk/ If you have commit rights on JBoss Cache then you'd probably have the same on this as well. In a nutshell, here's what the framework does: * Supports multiple cache products/versions/configs * Allows you to write your own test cases * Comes with some standard test cases * Produces simple CSV reports which you can import into your favourite spreadsheet software and generate graphs Here are some of the things I added today: * Basic replicated cache support (see docs/Documentation.txt for details) Some of the things I'd like to add: * Automated agent-based testing where each node in the cluster is stressed equally and data is measured on all nodes * Add throughput to the TestResult class * Automate the process of starting remote instances based on configuration settings Have a look, let me know your thoughts. I'm sure there are many areas for improvement, in terms of how the tests are run, reports generated, etc. As we start testing on bigger and bigger clusters, such frameworks could be very useful. Cheers, -- Manik Surtani Lead, JBoss Cache JBoss, a division of Red Hat Email: manik(a)jboss.org Telephone: +44 7786 702 706 MSN: manik(a)surtani.org Yahoo/AIM/Skype: maniksurtani _______________________________________________ jbosscache-dev mailing list jbosscache-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/jbosscache-dev _______________________________________________ jbosscache-dev mailing list jbosscache-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/jbosscache-dev