from the blog post: >The best any of them can do, however, is to make guesses as to what the optimal performance characteristics of the cache structure on each CPU is going to be.

Well actually most mainstream compilers support profile guided optimization which allows the compiler to do a good job of reorganizing the code to minimize instruction cache misses as the compiler then has runtime data which provides the necessary hot/cold codepath statistics.