No, we should not. The gems once installed should stay in place. If they are, the setup task is basically just verifying the right versions (which is fast). If you don't do it, one needs a manual setup once someone upgrades a dependency. Maybe the task should be better be called update.