Looking at this now, I think fail fast might be too strict compared to what we had.
Might be smarter to just log WARN instead of DEBUG (as we do now).