At my university, I had an (optional) course called high performance computing, which was 90% about writing cache efficient programs.