You're running dozens of threads over 16+ cores who don't all have the same properties to access and share memory (speed, invalidation, permission, ...).

The OS is in charge of deciding who runs where, and who shares a core with who.

So ... A lot.