I have also encountered this issue. Single Entity with multiple collections takes minutes to load using FetchMode.JOIN even though I have annotated the collection fields with FetchMode.SELECT. This is only when using an EntityGraph to load the entities.

Versions in environment are all the same as OP.