[infinispan-dev] distribution's impact on performance

[Mircea Markus]

Hi,

I've enhanced Radargun with an ideal distribution function: this is  a perfectly correct behaving function that is aware of the keys passed to it and  makes sure that all the nodes have the same share of keys(I'll send an email soon detailing this behavior),
I've just run a 3-9 test on the cluster{01..10}.mw.lab.eng.bos.redhat.com, results attached.
The ideal distribution causes the performance to be more linear. Also for puts we have an constant 10-35% performance increase.   
In the case of default CH 3 nodes, the get has a peek, this can be explained by the fact that two of the nodes moved really fast, almost as in replicated mode, as they hold most the data (90%) (see bellow num of keys on each node);.

Below is the distribution of keys/nodes[1] :

Configuration : dist-sync.xml
Cluster size: 3 -> ( 2930 2612 458)
Cluster size: 5 -> ( 1922 1930 660 2969 2519)
Cluster size: 7 -> ( 4617 1271 720 1028 4394 328 1642)
Cluster size: 9 -> ( 2586 4507 1153 556 1292 274 582 2560 4490)

Configuration : idealdistribution/dist-sync-ideal-distribution.xml
Cluster size: 3 -> ( 2000 2000 2000)
Cluster size: 5 -> ( 2000 2000 2000 2000 2000)
Cluster size: 7 -> ( 2000 2000 2000 2000 2000 2000 2000)
Cluster size: 9 -> ( 2000 2000 2000 2000 2000 2000 2000 2000 2000)

[1] this can now be obtained by running (./bin/dist.sh - just added).

Cheers,

Mircea  


-------------- next part --------------
A non-text attachment was scrubbed...
Name: All_GET.png
Type: image/png
Size: 44785 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20110201/42a3c121/attachment-0002.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: All_PUT.png
Type: image/png
Size: 37343 bytes
Desc: not available
Url : http://lists.jboss.org/pipermail/infinispan-dev/attachments/20110201/42a3c121/attachment-0003.png