> Last time I looked at the speedup you got from loop optimization it at most a few percent for a very simple loop.

Wow, no. Most loop optimizations make loops significantly faster, even an order of magnitude is not uncommon. Write a few loops and compare the code generated by any compiler with O0 vs O3.