On 04/21/2010 10:55 AM, Daniel Kavanagh wrote: I think that 0 errors and 0 failures would be better :-) There are certainly tests which doesn't applies for all databases. Most of them uses a method like "appliesTo(Dialect dialect)", like org.hibernate.test.rowid.RowIdTest . There are also plans to use @SkipForDialect and @RequiresDialect , but I'm not sure what's the current plans for that. But note that changing the tests may not be possible, specially if the dialect won't ship with Hibernate. In this case, you may want to document those "known issues" and waive them. If it's a bug in Hibernate, just open a JIRA with the test case and someone will look/fix. Not yet. But running the testsuite against "hsqldb" is a good starting point, as it usually passes 100% (no errors nor failures). - Juca.