News for hackers. Stuff that matters.

A comment on Annoying A/B testing mistakes every engineer should know. Parent comment

Re:Annoying A/B testing mistakes every engineer should know by ano-ther on Friday June 16, 2023 @05:26PM (#36364131)
Good observation that the noticing doesn’t get tested.

Would there be any benefit from knowing the notice rate though? After all, the intended outcome is increased sales by clicking.

[ Parent | on HN ]
Re:Annoying A/B testing mistakes every engineer should know by alsiola on Friday June 16, 2023 @05:57PM (#36364478)
This is what I was driving at in my original comment - the intermediary steps are not of interest (from the POV of the hypothesis/overall experiment), so why mention them at all.
[ Parent | on HN ]
Re:Annoying A/B testing mistakes every engineer should know by ricardobeat on Friday June 16, 2023 @06:10PM (#36364613)
Probably not, but then that hypothesis should not be part of the experiment.
[ Parent | on HN ]