Test report is saved into dedicated file under current wotking directory in both run modes, see TestReporter. Only debug logs are printed to stdout. But of course I can change it to use logging framework.

I see. I didn't see it when I run the incontainer test. Might be my fault. If it is there and the same file is used for both modes I am ok with it.

> The used Search version should be configurable, eg via profiles...
Good point, I will do it.

Great.

The question here is, against which database to run performance tests by default? Because results with usage of in-memory database will not be probably very useful.

In memory is fine imo for the minimal profile. The aim is more to make sure that the code does not get stale because it not compiled/executed. To run an actual performance test would would active a db profile of choice.