In Section 2.9, Entity Relationships, the JPA 2.1 spec says:

"If the entity being orphaned is a detached, new, or removed entity, the semantics of orphanRemoval do not apply."

This is expected behavior.