Currently all test entities used by a test class are compiled in one go via a @BeforeClass method in CompilationTest. This causes all test methods of a given class to fail if there is an issue with a test entity only used by a single test method, making failures more complicated to analyze.

As an alternative, the classes to be compiled could be specified on a per method base, e.g. like this:

@Test
@WithClasses( { Foo.class, Bar.class } )
public void testFoo() { ... }