Before dropping down to assembly or even intrinsics, check out ISPC. It's a little tricky to learn how to use varying and uniform and the compiler crashes here and there, but my god if it doesn't produce crazy fast programs.