[infinispan-issues] [JBoss JIRA] (ISPN-4841) TopologyAwareConsistentHashFactory is slow for large cluster

[Dan Berindei (JIRA)]

    [ https://issues.jboss.org/browse/ISPN-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020791#comment-13020791 ] 

Dan Berindei commented on ISPN-4841:
------------------------------------

SyncConsistentHashFactory seems to be much better in this regard, so ISPN-4851 should help. SyncConsistentHashFactory results could also be cached, since they only depend on the hash codes of the members.


> TopologyAwareConsistentHashFactory is slow for large cluster
> ------------------------------------------------------------
>
>                 Key: ISPN-4841
>                 URL: https://issues.jboss.org/browse/ISPN-4841
>             Project: Infinispan
>          Issue Type: Enhancement
>          Components: Core
>    Affects Versions: 7.0.0.CR1
>            Reporter: Takayoshi Kimura
>
> A user observed 100% CPU usage for a long time on coordinator node when booting 500 nodes with 500 caches defined.
> It looks like the TopologyAwareConsistentHashFactory performs O(n^2), it has double loop for all Machines. It takes 50 sec to compute rebalance with 1 cache 500 nodes. This calculation is performed on every cache, so it eats 25000 sec CPU times with 500 nodes 500 caches.
> The hprof shows 90% of the time is consumed in the TopologyInfo.computeMaxSegmentsForMachine().



--
This message was sent by Atlassian JIRA
(v6.3.8#6338)