Re:Let’s fix font size
by danShumway on Tuesday March 30, 2021 @04:51PM
(#26640296)
Any kind of user customization will have the same effect. Any preference that the user can edit can be a confounding variable in an A/B test.
I don't want to live in a software world where as a user I'm forced into a one-size-fits-all approach to every interface just because it makes A/B testing easier.
I would posit that if rendering differences in font display are affecting A/B testing a workflow, the A/B testing apparatus has failed to control for confounding factors and was probably invalid anyway. If OSX is known to render differently than Windows (and it's not just fonts), why are you comparing cohort A from Windows to cohort B from OSX? That is an analysis error.
A lot of work goes into UX research and A/B testing, if fonts are too flexible none of your results will be meaningful.