[infinispan-dev] test number variations

[Mircea Markus]

On 1 Jun 2012, at 11:56, Pete Muir wrote:

> TestNG/surefire in combo are dreadful at counting the number of tests. If you get errors, it will start counting failed before/after methods as well as real test methods. You basically shouldn't trust the count from any run except one where every test passed.
> 
> I would strongly advise using JUnit for this, and many other reasons:
+1
> 
> * much better hooks into surefire, eclipse etc. etc.
> * much more stable (rarely do I see bugs like this in it)
> * you can actually debug the JUnit code without going blind
> * much more flexible / extensible, due to use of runners
> 
> BUT it doesn't have the built in features TestNG has...
I'd much rather go with something predictable and simpler.