[jbosscache-dev] Cache benchmarking framework

[Manik Surtani]

One of the things I want o do before releasing 2.0.0.BETA2 is to get  
some idea of performance, with respect to earlier versions of JBoss  
Cache.  As such, I dug up something I started a couple of years ago,  
the CacheBenchFwk, and tidied a few things up.

If you are interested in this, have a look at:

	http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jboss/CacheBenchFwk/

If you have commit rights on JBoss Cache then you'd probably have the  
same on this as well.

In a nutshell, here's what the framework does:

* Supports multiple cache products/versions/configs
* Allows you to write your own test cases
* Comes with some standard test cases
* Produces simple CSV reports which you can import into your  
favourite spreadsheet software and generate graphs

Here are some of the things I added today:

* Basic replicated cache support (see docs/Documentation.txt for  
details)

Some of the things I'd like to add:

* Automated agent-based testing where each node in the cluster is  
stressed equally and data is measured on all nodes
* Add throughput to the TestResult class
* Automate the process of starting remote instances based on  
configuration settings

Have a look, let me know your thoughts.  I'm sure there are many  
areas for improvement, in terms of how the tests are run, reports  
generated, etc.  As we start testing on bigger and bigger clusters,  
such frameworks could be very useful.

Cheers,
--
Manik Surtani

Lead, JBoss Cache
JBoss, a division of Red Hat

Email: manik at jboss.org
Telephone: +44 7786 702 706
MSN: manik at surtani.org
Yahoo/AIM/Skype: maniksurtani