On 29 Oct 2012, at 09:10, Galder Zamarreño wrote:

On Oct 29, 2012, at 8:59 AM, Anna Manukyan <amanukya@redhat.com> wrote:

Hi Sanne,

sorry for my interfering in - I was lately working on CDI testsuite - evaluating the coverage, etc. and actually on my local environment as well as on Jenkins, the CDI integration tests are passing properly.

I've run the tests several times, but I hadn't got the test hangouts as you have mentioned and all tests are passing on my side without failures.

I've tried also the testsuite execution with TestNG version 6.7 and it is fine as well.

I just thought, maybe there is something wrong with your testsuite setup or environment (just thoughts)?

We've seen CDI testsuite fail massively at points due to some bug in TestNG, and although I cannot find the exact email right now, I thought long term the idea was to move to JUnit.

Switching to JUnit won't happen very soon unfortunately, so upgrading TestNG should still be done that we won't have this kind of issues.

Example: https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/867/#showFailuresLink

@Sanne, if you see tests failing (apart from the massive CDI failure thing, if it looks like the failures in the link above), create a JIRA and assign it to the right person. The problem is disabling the tests which is a bit tedious if you're doing per JIRA, but you could batch them up.