[infinispan-dev] Test groups

[Sebastian Łaskawiec]

Hi!

Recently I've been working with some tests and I noticed that we have
pretty large number of Maven profiles responsible for selecting which
test suites should be executed:

      * test-CI
      * test-functional
      * test-jgroups
      * test-transaction
      * test-unit
      * test-unstable
      * test-xsite

Perhaps some of them might be removed and we could create some more
useful hierarchy. Here is my proposition:

      * test-smoke - all unit test with some basic functional tests
        based on Arquillian. This profile would be invoked by default
        and with our CI server.  There is already a ticket to implement
        such profile in Jira [1]. I think it would be a good practice to
        reject all Pull Requests which fail against this profile. 
      * test-acceptance - Full test suite without performance test. This
        should be executed once a day (nightly profile?)
      * test-performance - Reserved for performance/stress tests.
      * test-code-quality - test-acceptance with Sonar, Firebug, Jacoco
        or any other tool for measuring code quality. Executed once a
        day.

In my opinion above hierarchy will help to identify serious problems
faster and will help us in productisation stream.

What do you think?

[1] https://issues.jboss.org/browse/ISPN-4665

Best regards
Sebastian
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20140901/9e79357f/attachment.html