Ok, I figured out what was happening here. I was storing some (Long) ids multiple times with @Fields.

If I understand it correctly, Now, this leads to a Long being stored as a NumericField by default whereas previously it would become a String.