Just tried it, it works as I'd expect.

Can be seen here: https://github.com/rsmeral/deltaspike-examples/tree/window-scoped-identity/expense-tracker .
The app is not completely ready for concurrent multi-user operation (entities don't properly refresh, EntityManager has wider scope than necessary, etc.).
However, the user-per-window feature works.