I'm sure we had a reason to had the reference counting, we did not do it for the fun of it. I unfortunately don't quite remember why.
Might be related to the mutable SearchFactory.