Ah, nice, thanks for the correction.

Site Settings only appears on the website, for Lichess app users like me who couldn't find it. But once you change the setting there it will apply in the mobile app if you're logged in.