Hi Christian,
did you apply more cache settings (for instance for collection) for your tests?
Unfortunately I had no time to look into it yet but it is still on my TODO list ;)
It is definitely issue that must be addressed as soon as possible. As far as I can tell there is no jira issue for this. so perhaps it is time to create one.
Cheers,
Maciej