I guess that's the logical extreme of what Gentoo is doing, just without the speed benefits (since the compiler is under time pressure and thus won't do a great job). Maybe if you combine it with profile guided optimization? (Yes, this is basically reinventing Java/.NET)