<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/3.12.3">
</HEAD>
<BODY>
To strengthen your argument, I had 385 build messages in my e-mail and here is the breakdown:<BR>
<BR>
79 of the 385 or 20.5% were outright build failures<BR>
231 of the 385, or 60% were build completed with test suite failures<BR>
52 of the 385, or 13.5% were build that successfully completed<BR>
11 of the 385, or 3% were builds that timed out (probably infrastructure related)<BR>
12 of the 385, or 3% were builds that were fixed<BR>
<BR>
Over 80% of all builds across all projects failed or had testsuite failures.<BR>
<BR>
Andy<BR>
<BR>
On Thu, 2007-06-21 at 11:39 -0400, Bill Burke wrote:
<BLOCKQUOTE TYPE=CITE>
<PRE>
<FONT COLOR="#000000">The productivity of teams like EJB 3.0 has been severely compromised for </FONT>
<FONT COLOR="#000000">over a year because projects. 60% of the reason I didn't want to work </FONT>
<FONT COLOR="#000000">on EJB 3 anymore was because I would not commit anything for a week or </FONT>
<FONT COLOR="#000000">two and come back to find that half of my unit tests were broken. This </FONT>
<FONT COLOR="#000000">has gotten worse and worse as projects have split off from jboss-head.</FONT>
<FONT COLOR="#000000">There is ZERO peer pressure for breaking the build. Nobody cares. </FONT>
<FONT COLOR="#000000">Since the testsuites *ALWAYS* fail, nobody is paying attention to </FONT>
<FONT COLOR="#000000">regressions except for the individual projects where it fails. You even </FONT>
<FONT COLOR="#000000">have cases where people comment out failing tests! We just *cannot* do </FONT>
<FONT COLOR="#000000">the refactorings that the majority of teams want to do without a stable </FONT>
<FONT COLOR="#000000">testsuite.</FONT>
<FONT COLOR="#000000">This has to be fixed immediately. Since there is ZERO peer pressure, </FONT>
<FONT COLOR="#000000">there needs to be consequences for breaking the build or regressing. I </FONT>
<FONT COLOR="#000000">propose the following:</FONT>
<FONT COLOR="#000000">1. Calculate a baseline of passed vs. failed tests</FONT>
<FONT COLOR="#000000">2. Tag HEAD</FONT>
<FONT COLOR="#000000">3. If there is any testsuite regression or build breakage, freeze SVN </FONT>
<FONT COLOR="#000000">until the build or regressions are fixed.</FONT>
<FONT COLOR="#000000">4. If build or regressions are fixed within 24 hours. Rollback to </FONT>
<FONT COLOR="#000000">previous tag</FONT>
<FONT COLOR="#000000">5. If no regressions or breakage, recalculate baseline and tag head</FONT>
<FONT COLOR="#000000">6. GOTO 3</FONT>
<FONT COLOR="#000000">Bill</FONT>
<FONT COLOR="#000000">Dimitris Andreadis wrote:</FONT>
<FONT COLOR="#000000">> Given the multitude of component updates and our carelessness, it's a </FONT>
<FONT COLOR="#000000">> rare thing to see jboss AS testsuites run at 100%, A lot of stuff is </FONT>
<FONT COLOR="#000000">> just checked in without testing it locally, and worse, the CC runs that </FONT>
<FONT COLOR="#000000">> show failures after the check-ins are ignored.</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> The good new is we finally got there for 4.2.x. (minus </FONT>
<FONT COLOR="#000000">> occasional/transient timing failures), so let's keep it that way for </FONT>
<FONT COLOR="#000000">> that branch, and help fix the other ones, especially HEAD.</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> On a broken testsuite it's very "convenient" to just ignore failures, </FONT>
<FONT COLOR="#000000">> since "somebody else must have done it".</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> Cheers</FONT>
<FONT COLOR="#000000">> /Dimitris</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> ===========================</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> View results here -></FONT>
<FONT COLOR="#000000">> <A HREF="http://cruisecontrol.jboss.com/cc/buildresults/jboss-4.2-testsuite-sun-1.5?log=log20070620223106Lbuild.48">http://cruisecontrol.jboss.com/cc/buildresults/jboss-4.2-testsuite-sun-1.5?log=log20070620223106Lbuild.48</A> </FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> BUILD COMPLETE - build.48</FONT>
<FONT COLOR="#000000">> Date of build: 06/20/2007 22:31:06</FONT>
<FONT COLOR="#000000">> Time to build: 165 minutes 8 seconds</FONT>
<FONT COLOR="#000000">> </FONT>
<FONT COLOR="#000000">> Unit Tests: (4087) Total Errors and Failures: (0)</FONT>
<FONT COLOR="#000000">> All Tests Passed</FONT>
<FONT COLOR="#000000">> _______________________________________________</FONT>
<FONT COLOR="#000000">> jboss-development mailing list</FONT>
<FONT COLOR="#000000">> <A HREF="mailto:jboss-development@lists.jboss.org">jboss-development@lists.jboss.org</A></FONT>
<FONT COLOR="#000000">> <A HREF="https://lists.jboss.org/mailman/listinfo/jboss-development">https://lists.jboss.org/mailman/listinfo/jboss-development</A></FONT>
</PRE>
</BLOCKQUOTE>
<TABLE CELLSPACING="0" CELLPADDING="0" WIDTH="100%">
<TR>
<TD>
Andrig (Andy) Miller<BR>
VP of Engineering<BR>
JBoss, a division of Red Hat
</TD>
</TR>
</TABLE>
</BODY>
</HTML>