Isn’t exception handling code placed in the cold section of the binary these days so that the impact on cache is nonexistent?

Yup, the generated assembly does this. There’s some minimal extra instructions still to setup the frame but the bulk of the exception handling lives elsewhere.