[infinispan-dev] test number variations

[Sanne Grinovero]

Don't look at the last test builds but at the trends in the graphs.

look at this specific module, even ignoring the number of failures,
the total number of executed tests seems to vary between 58 and 237 :

https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cdi/test/?width=800&height=600

Other modules have less dramatic changes, but still not stable. The
other module I linked to was to show a stable one, in terms of
variations of number of tests (ignore failures).


On 1 June 2012 09:51, Manik Surtani <manik at jboss.org> wrote:
> Those are different modules though.  What about overall?  One explanation could be that an entire module fails to build so its tests aren't counted in the overall count.
>
> On 1 Jun 2012, at 00:59, Sanne Grinovero wrote:
>
>> Hi all,
>>
>> I just noticed the number of tests reported by CI varies significantly
>> across builds.
>>
>> I'm not referring to the number of failures or errors, but the total
>> number of tests executed; for example, it seems the last build had 249
>> less than the build from yesterday.
>>
>> It just happens that we have nice graphs to look at, and some are rock-stable:
>>
>> https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cachestore-bdbje/test/?width=800&height=600
>>
>> while others are rock-as-mountains ??
>>
>> https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cdi/
>>
>> Is anyone having a reassuring explanation?
>>
>> Cheers,
>> Sanne
>> _______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
> --
> Manik Surtani
> manik at jboss.org
> twitter.com/maniksurtani
>
> Lead, Infinispan
> http://www.infinispan.org
>
>
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev