Got some response from the Apollo community.
Instead of replacing the route and the middleware, they suggest replacing the app completely.
I think this makes sense because it doesn't use any internals of Apollo server.

What happens to existing open connections is still a question though.