[jbosscache-dev] Cache benchmarking framework

[Mircea Markus]

Hi,

Another thing that might be interested to test is the best eviction
algorithm to be used in a certain scenario.
Given a context(client), an eviction algorithm is 'better' than another one
if it manages to return more cached elements, as client ask for them.
(any other definitions of 'better' when it comes to eviction policies?)
As the benchmark supports multiple configs, it might be useful in helping
clients to fine tune their eviction policies.

Cheers,
Mircea

On 3/13/07, Manik Surtani <manik at jboss.org> wrote:
>
> One of the things I want o do before releasing 2.0.0.BETA2 is to get
> some idea of performance, with respect to earlier versions of JBoss
> Cache.  As such, I dug up something I started a couple of years ago,
> the CacheBenchFwk, and tidied a few things up.
>
> If you are interested in this, have a look at:
>
>         http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jboss/CacheBenchFwk/
>
> If you have commit rights on JBoss Cache then you'd probably have the
> same on this as well.
>
> In a nutshell, here's what the framework does:
>
> * Supports multiple cache products/versions/configs
> * Allows you to write your own test cases
> * Comes with some standard test cases
> * Produces simple CSV reports which you can import into your
> favourite spreadsheet software and generate graphs
>
> Here are some of the things I added today:
>
> * Basic replicated cache support (see docs/Documentation.txt for
> details)
>
> Some of the things I'd like to add:
>
> * Automated agent-based testing where each node in the cluster is
> stressed equally and data is measured on all nodes
> * Add throughput to the TestResult class
> * Automate the process of starting remote instances based on
> configuration settings
>
> Have a look, let me know your thoughts.  I'm sure there are many
> areas for improvement, in terms of how the tests are run, reports
> generated, etc.  As we start testing on bigger and bigger clusters,
> such frameworks could be very useful.
>
> Cheers,
> --
> Manik Surtani
>
> Lead, JBoss Cache
> JBoss, a division of Red Hat
>
> Email: manik at jboss.org
> Telephone: +44 7786 702 706
> MSN: manik at surtani.org
> Yahoo/AIM/Skype: maniksurtani
>
>
> _______________________________________________
> jbosscache-dev mailing list
> jbosscache-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/jbosscache-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/jbosscache-dev/attachments/20070515/0f944e95/attachment.html