Those benchmarks seem to be more GPU based as well. e.g. something like Geekbench (not that it's necessarily that representative either) is just 2-3x faster.
https://www.cpu-monkey.com/en/compare_cpu-apple_m4-vs-intel_...
https://www.cpu-monkey.com/en/compare_cpu-apple_m4-vs-intel_...
When normal users are thinking "faster" they are really thinking about snappiness/responsiveness, not number crunching.