Turns out that the test is already using hibernate.jpa.compliance.closed=true, as the entity manager is actually container managed. Still a good catch though, to configure properties like hibernate.jpa.compliance.closed for other non-container managed tests.

Looks like the bug is that SessionFactoryIml.close() checks getJpaCompliance().isJpaClosedComplianceEnabled() but SessionIml.close() does not.