[infinispan-dev] test number variations

[Manik Surtani]

Could be due to a bad check-in where someone annotates a test with @Test(invocationCount = xxxx) - I have seen this a few times.

On 1 Jun 2012, at 10:43, Sanne Grinovero wrote:

> Don't look at the last test builds but at the trends in the graphs.
> 
> look at this specific module, even ignoring the number of failures,
> the total number of executed tests seems to vary between 58 and 237 :
> 
> https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cdi/test/?width=800&height=600
> 
> Other modules have less dramatic changes, but still not stable. The
> other module I linked to was to show a stable one, in terms of
> variations of number of tests (ignore failures).
> 
> 
> On 1 June 2012 09:51, Manik Surtani <manik at jboss.org> wrote:
>> Those are different modules though.  What about overall?  One explanation could be that an entire module fails to build so its tests aren't counted in the overall count.
>> 
>> On 1 Jun 2012, at 00:59, Sanne Grinovero wrote:
>> 
>>> Hi all,
>>> 
>>> I just noticed the number of tests reported by CI varies significantly
>>> across builds.
>>> 
>>> I'm not referring to the number of failures or errors, but the total
>>> number of tests executed; for example, it seems the last build had 249
>>> less than the build from yesterday.
>>> 
>>> It just happens that we have nice graphs to look at, and some are rock-stable:
>>> 
>>> https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cachestore-bdbje/test/?width=800&height=600
>>> 
>>> while others are rock-as-mountains ??
>>> 
>>> https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/org.infinispan$infinispan-cdi/
>>> 
>>> Is anyone having a reassuring explanation?
>>> 
>>> Cheers,
>>> Sanne
>>> _______________________________________________
>>> infinispan-dev mailing list
>>> infinispan-dev at lists.jboss.org
>>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
>> 
>> --
>> Manik Surtani
>> manik at jboss.org
>> twitter.com/maniksurtani
>> 
>> Lead, Infinispan
>> http://www.infinispan.org
>> 
>> 
>> 
>> 
>> _______________________________________________
>> infinispan-dev mailing list
>> infinispan-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/infinispan-dev
> 
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev

--
Manik Surtani
manik at jboss.org
twitter.com/maniksurtani

Lead, Infinispan
http://www.infinispan.org