Are we talking about the install that is used already have an
install of the test plugin
Yes, that's what we are talking about: when test plugin is a
singleton, and a previous test already installed another version of
this singleton in the install.
It's not blocker usage, but it makes the feedback loop longer while
writing/testing/debugging a test.