[infinispan-issues] [JBoss JIRA] Commented: (ISPN-350) Improve evenness of distribution

Thu May 13 10:45:27 EDT 2010

    [ https://jira.jboss.org/jira/browse/ISPN-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12530553#action_12530553 ] 

Manik Surtani commented on ISPN-350:
------------------------------------

Implementing ISPN-423 has really helped.  Here is where we stand now.

Infinispan:

10:00:01,432 INFO  [WebSessionBenchmarkStage] On slave 4 we had 9,429 requests per second
10:00:01,433 INFO  [WebSessionBenchmarkStage] On slave 6 we had 9,305 requests per second
10:00:01,433 INFO  [WebSessionBenchmarkStage] On slave 1 we had 9,190 requests per second
10:00:01,433 INFO  [WebSessionBenchmarkStage] On slave 0 we had 8,672 requests per second
10:00:01,433 INFO  [WebSessionBenchmarkStage] On slave 3 we had 8,446 requests per second
10:00:01,434 INFO  [WebSessionBenchmarkStage] On slave 7 we had 8,141 requests per second
10:00:01,434 INFO  [WebSessionBenchmarkStage] On slave 2 we had 8,005 requests per second
10:00:01,434 INFO  [WebSessionBenchmarkStage] On slave 5 we had 7,049 requests per second

against <a popular proprietary product>: 

10:01:43,366 INFO  [WebSessionBenchmarkStage] On slave 0 we had 11,274 requests per second
10:01:43,366 INFO  [WebSessionBenchmarkStage] On slave 5 we had 11,171 requests per second
10:01:43,366 INFO  [WebSessionBenchmarkStage] On slave 1 we had 11,105 requests per second
10:01:43,367 INFO  [WebSessionBenchmarkStage] On slave 3 we had 11,049 requests per second
10:01:43,367 INFO  [WebSessionBenchmarkStage] On slave 4 we had 11,016 requests per second
10:01:43,367 INFO  [WebSessionBenchmarkStage] On slave 2 we had 10,943 requests per second
10:01:43,367 INFO  [WebSessionBenchmarkStage] On slave 7 we had 10,948 requests per second
10:01:43,367 INFO  [WebSessionBenchmarkStage] On slave 6 we had 10,873 requests per second

> Improve evenness of distribution
> --------------------------------
>
>                 Key: ISPN-350
>                 URL: https://jira.jboss.org/jira/browse/ISPN-350
>             Project: Infinispan
>          Issue Type: Feature Request
>          Components: Distributed Cache
>    Affects Versions: 4.0.0.CR4
>            Reporter: Manik Surtani
>            Assignee: Manik Surtani
>             Fix For: 4.1.0.CR1, 4.1.0.Final
>
>
> On this 8-node run, compare the stats measured on each node when using Infinispan:
> 2010-02-12 07:03:59,123 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 4 we had 9,739 requests per second
> 2010-02-12 07:03:59,123 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 7 we had 3,634 requests per second
> 2010-02-12 07:03:59,123 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 1 we had 2,966 requests per second
> 2010-02-12 07:03:59,123 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 3 we had 2,935 requests per second
> 2010-02-12 07:03:59,124 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 2 we had 2,930 requests per second
> 2010-02-12 07:03:59,124 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 5 we had 2,925 requests per second
> 2010-02-12 07:03:59,124 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 6 we had 2,922 requests per second
> 2010-02-12 07:03:59,124 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 0 we had 2,910 requests per second
> against <a popular proprietary product>:
> 2010-02-12 06:43:44,747 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 1 we had 12,188 requests per second
> 2010-02-12 06:43:44,748 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 7 we had 12,001 requests per second
> 2010-02-12 06:43:44,748 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 0 we had 11,978 requests per second
> 2010-02-12 06:43:44,748 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 5 we had 11,967 requests per second
> 2010-02-12 06:43:44,748 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 3 we had 11,994 requests per second
> 2010-02-12 06:43:44,749 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 6 we had 11,961 requests per second
> 2010-02-12 06:43:44,749 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 4 we had 11,983 requests per second
> 2010-02-12 06:43:44,749 [main] INFO  [org.cachebench.stages.WebSessionBenchmarkStage] On slave 2 we had 11,814 requests per second
> This is due to the fact that keys are inequally distributed and some nodes have to deal with greater load than others.
> We need to revisit the bit spreaders we use as well as the way we place nodes on a hash wheel and try and improve on this.  Virtual nodes may help as well, although that adds significant complexity to the distribution implementation.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira