[JBoss-dev] RE: Fixing the testsuite for JRockit

[Ryan Campbell]

The testsuite runs should now be isolated from each other.  There have
been a couple classes of problems:

1. At one point (few weeks ago), we were running testsuites in parallel
on two different boxes, but the clustering tests conflicted.  We stopped
doing this.

2. We have historically (months ago) seen stale JBoss processes hanging
around, but I haven't seen this recently.  We go to great lengths to
make sure the box is clean.  Maybe this has regressed, but I haven't
seen this.

-----Original Message-----
From: Dimitris Andreadis 
Sent: Thursday, September 07, 2006 9:05 AM
To: JBoss.org development list; QA
Subject: Fixing the testsuite for JRockit

An important task for the jbas codebase is to fix the testsuite when run
under the jrockit JVM. This is initially for the 4.x branch but the
fixes should apply verbatim to jboss head.

The starting point is here (see linked tasks & subtasks)
http://jira.jboss.com/jira/browse/JBAS-3598
http://cruisecontrol.jboss.com/cc/buildresults/jboss-4.0-testsuite-1.4

At any time there are anywhere between 54-58 failures, so if something
is in your area please have a go. We'll be assigning tasks to people,
soon.

Same thing for the testsuite when run under sun-jdk5 (around 10
failures)
http://cruisecontrol.jboss.com/cc/buildresults/jboss-4.0-testsuite-sun-1
.5
http://jira.jboss.com/jira/browse/JBAS-3611

There are also a lot of transient failures in parts of the testsuite
that are more sensitive to timing/cpu issues (e.g. JMS), so subsequent
runs often produce different results. This may also have to do with
testsuite runs that interfere with each other.

If we can (a) improve those parts of the testsuite and (b) make sure
testsuite runs are more isolated from each other, that would be an
improvement.

(I see already a related task from Adrian:
http://jira.jboss.com/jira/browse/JBAS-3221)

Thanks
/Dimitris