<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/4.6.6">
</HEAD>
<BODY>
Hi!<BR>
<BR>
Recently I've been working with some tests and I noticed that we have pretty large number of Maven profiles responsible for selecting which test suites should be executed:
<UL>
<LI>test-CI
<LI>test-functional
<LI>test-jgroups
<LI>test-transaction
<LI>test-unit
<LI>test-unstable
<LI>test-xsite
</UL>
Perhaps some of them might be removed and we could create some more useful hierarchy. Here is my proposition:
<UL>
<LI>test-smoke - all unit test with some basic functional tests based on Arquillian. This profile would be invoked by default and with our CI server. There is already a ticket to implement such profile in Jira [1]. I think it would be a good practice to reject all Pull Requests which fail against this profile.
<LI>test-acceptance - Full test suite without performance test. This should be executed once a day (nightly profile?)
<LI>test-performance - Reserved for performance/stress tests.
<LI>test-code-quality - test-acceptance with Sonar, Firebug, Jacoco or any other tool for measuring code quality. Executed once a day.
</UL>
In my opinion above hierarchy will help to identify serious problems faster and will help us in productisation stream.<BR>
<BR>
What do you think?<BR>
<BR>
[1] <A HREF="https://issues.jboss.org/browse/ISPN-4665">https://issues.jboss.org/browse/ISPN-4665</A><BR>
<BR>
Best regards<BR>
Sebastian
</BODY>
</HTML>