The performance report should go into a dedicated file and not just to standard out...

Test report is saved in dedicated file under current wotking directory in both run modes, see TestReporter. Only debug logs are printed to stdout. But of course I can change it to use logging framework.

The used Search version should be configurable, eg via profiles.

Good point, I will do it.