Cache benchmarking framework
by Manik Surtani
One of the things I want o do before releasing 2.0.0.BETA2 is to get
some idea of performance, with respect to earlier versions of JBoss
Cache. As such, I dug up something I started a couple of years ago,
the CacheBenchFwk, and tidied a few things up.
If you are interested in this, have a look at:
http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jboss/CacheBenchFwk/
If you have commit rights on JBoss Cache then you'd probably have the
same on this as well.
In a nutshell, here's what the framework does:
* Supports multiple cache products/versions/configs
* Allows you to write your own test cases
* Comes with some standard test cases
* Produces simple CSV reports which you can import into your
favourite spreadsheet software and generate graphs
Here are some of the things I added today:
* Basic replicated cache support (see docs/Documentation.txt for
details)
Some of the things I'd like to add:
* Automated agent-based testing where each node in the cluster is
stressed equally and data is measured on all nodes
* Add throughput to the TestResult class
* Automate the process of starting remote instances based on
configuration settings
Have a look, let me know your thoughts. I'm sure there are many
areas for improvement, in terms of how the tests are run, reports
generated, etc. As we start testing on bigger and bigger clusters,
such frameworks could be very useful.
Cheers,
--
Manik Surtani
Lead, JBoss Cache
JBoss, a division of Red Hat
Email: manik(a)jboss.org
Telephone: +44 7786 702 706
MSN: manik(a)surtani.org
Yahoo/AIM/Skype: maniksurtani
17 years, 6 months