Sure. It should not be that much. There is definitely some weird stuff with turbo, mind you. Particularly because using heavy AVX2 or AVX512 loads changes the max turbo frequency for the cores they are running on (in broadwell) or all cores (in haswell).

https://images.anandtech.com/doci/11544/freqbehavioravx.png

It's quite significant for AVX512.

This really screws with benchmarking unless you are on something newer than haswell and isolate the core you are executing on.