[Hawkular-dev] Recent changes in hawkular-metrics performance tests

[Filip Brychta]

Hello,
there is one important change in the test setup.
Baselines are no longer taken from last successful job but are defined statically now. It means that any change to the baselines must be done manually. This was done to avoid silent performance drops and to have every baseline change documented. See [1] for details.

Another thing is reporting improvement. Simple report containing each build step and some instructions is now available on public VM (accessible outside of VPN). It should be easy to find out which build step failed and what to do to next without looking into internal jenkins job console logs. This report is accessible from each pull request (Details link next to haw-perf-stability-test check). Example: http://209.132.178.156/report268.html

Filip

[1] - https://mojo.redhat.com/docs/DOC-1045245