[infinispan-dev] distribution's impact on performance

[Mircea Markus]

On 1 Feb 2011, at 13:31, Manik Surtani wrote:

> Does your dummy hash function
it's not necessarily  dummy. It's a function that is aware of the key structure and based on that knows how to build even distribution - but is a correct fucntion.
> guarantee any number of puts or gets hitting the local node?  Or does it guarantee that all calls are remote?
It spreads the keys from each node to all nodes(including self) equally. 
> 
> On 1 Feb 2011, at 13:11, Mircea Markus wrote:
> 
>> Hi,
>> 
>> I've enhanced Radargun with an ideal distribution function: this is  a perfectly correct behaving function that is aware of the keys passed to it and  makes sure that all the nodes have the same share of keys(I'll send an email soon detailing this behavior),
>> I've just run a 3-9 test on the cluster{01..10}.mw.lab.eng.bos.redhat.com, results attached.
>> The ideal distribution causes the performance to be more linear. Also for puts we have an constant 10-35% performance increase.   
>> In the case of default CH 3 nodes, the get has a peek, this can be explained by the fact that two of the nodes moved really fast, almost as in replicated mode, as they hold most the data (90%) (see bellow num of keys on each node);.
>> 
>> Below is the distribution of keys/nodes[1] :
>> 
>> Configuration : dist-sync.xml
>> Cluster size: 3 -> ( 2930 2612 458)
>> Cluster size: 5 -> ( 1922 1930 660 2969 2519)
>> Cluster size: 7 -> ( 4617 1271 720 1028 4394 328 1642)
>> Cluster size: 9 -> ( 2586 4507 1153 556 1292 274 582 2560 4490)
>> 
>> Configuration : idealdistribution/dist-sync-ideal-distribution.xml
>> Cluster size: 3 -> ( 2000 2000 2000)
>> Cluster size: 5 -> ( 2000 2000 2000 2000 2000)
>> Cluster size: 7 -> ( 2000 2000 2000 2000 2000 2000 2000)
>> Cluster size: 9 -> ( 2000 2000 2000 2000 2000 2000 2000 2000 2000)
>> 
>> [1] this can now be obtained by running (./bin/dist.sh - just added).
>> 
>> Cheers,
>> 
>> Mircea  
>> 
>> 
>> <All_GET.png><All_PUT.png>_______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> 
> --
> Manik Surtani
> manik at jboss.org
> twitter.com/maniksurtani
> 
> Lead, Infinispan
> http://www.infinispan.org
> 
> 
> 
> 
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev