40% is pretty big, but over 7 years that's not much. It wasn't that long ago that 40% increases were happening every 2 or 3 years.

Gordon Moore would be very disappointed with 40% every 2-3 years. OTOH, he would probably like how GPUs are progressing.

Even though I'd say benchmarking fp16 GFLOPS against fp64 ones is cheating.

Moore's law I think is widely misunderstood as computer chips doubling in speed every two years (or something to that effect). In fact, what it says is that the number of transistors doubles every two years, which is still roughly true. In 2020, its hard to buy single-threaded CPU speed by just throwing more transistors on a chip, which is why most performance gains have been found in multithreaded workloads (because you can trivially get more CPU cores by putting more transistors on a chip).

I would love if I could find where my OS could collect informations on how long my CPUs stall for lack of proper execution ports, lacking parallelism in the code, L1-3 cache misses and so on.

If you're on Linux look at

  perf list 

then

  perf top -e [...]