bq. The performance report should go into a dedicated file and not just to standard out...
Test report is saved in into dedicated file under current wotking directory in both run modes, see [TestReporter|https://github.com/thradec/hibernate-search/blob/performance-tests/integrationtest/performance2/src/test/java/org/hibernate/search/test/performance/scenario/TestReporter.java#L167-L171]. Only debug logs are printed to stdout. But of course I can change it to use logging framework.
bq. The used Search version should be configurable, eg via profiles. ..
Good point, I will do it.
bq. The code should compile and run in a minimal configuration as part of the build...
The question here is, against which database to run performance tests by default? Because results with usage of in-memory database will not be probably very useful.
|