I just found it - it's "Git > Blame > Editor Decoration: Enabled" and holy is it so much faster. I love every time I can replace an extension with native functionality.