[infinispan-dev] State transfer performance

[Bela Ban]

Rather than (or in addition to) using log parsing, how about using 
Byteman to inject aspects measuring things such as join time, state 
transfer time, view installation time, state transfer time / state size 
and so on ?

On 10/12/12 1:52 PM, Radim Vansa wrote:
> Hi,
>
> yes, we did this kind of tests for ispn 5.1 releases. There was pretty easy to analyze the join time parsing the logs for debug messages from CacheViewsManagerImpl, one such example is
>
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jdg-60-radargun-elasticity-tx/5/artifact/report/loganalysis/views.html
>
> However, currently there is no such obvious start/end: I have created a log parser isolating some info (note that this is from two consecutive runs in radargun with two configurations)
>
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/ispn-52-radargun-resilience-dist-tx/37/artifact/report/loganalysis/statetransfers.html
>
> It is not as nice, but still better than the logs itself.
> Therefore, if we should benchmark some interval, we have to exactly state which events should be the start and end. Could you suggest anything?
> We should also define the type of load. Should be the load random, or should we let each client query for one key and check when it is able to acquire the key and when we have to wait for long (because the segment with this key is transferred)?
>
> Radim
>
> ----- Original Message -----
> | From: "Mircea Markus"<mircea.markus at jboss.com>
> | To: "infinispan"<infinispan-dev at lists.jboss.org>, "Martin Gencur"<mgencur at redhat.com>
> | Sent: Friday, October 12, 2012 1:16:04 PM
> | Subject: [infinispan-dev] State transfer performance
> |
> |
> |
> |
> | Hi ,
> |
> | One of the targets of NBST is to minimise the downturn in throughput
> | during topology changes. And now that NBST is getting there, I think
> | that a test to measure how long does it take to a node to join,
> | under different levels of cluster load, is very desirable in order
> | to see where we are and also to help us profile and improve the
> | state transfer performance.
> | Martin, are we doing this kind of performance testing? It would be
> | nice to have it integrated in Radargun or something similar in order
> | to be able to quickly run it.

-- 
Bela Ban, JGroups lead (http://www.jgroups.org)