> 99% of people visiting my sites won't actually have set this value themselves.

It's inherited from their operating system settings. Dark theme is typically opt-in.