I don't think spawning additional threads at runtime would be great actually.
If it's just a matter of not blocking all on pool empty, we could have a thread replenish the pool when we're halfway full, as long as this doesn't block the other threads.

I also guess the issue would be far less dramatic by setting a larger pool?