News for hackers. Stuff that matters.
Re:A/B testing mistakes I learned the hard way by iamcreasy on Saturday August 10, 2024 @08:37PM (#41213215)
The article says 'Changing the color of the "Proceed to checkout" button will increase purchases.' is a bad hypothesis because it is underspecified.

But what else is there to measure other than checkout button click count(and follow up purchases) to measure the effect of button color change?

Or perhaps this is not a robust example to illustrates undespeficaition?

Re:A/B testing mistakes I learned the hard way by KTibow on Sunday August 11, 2024 @12:45AM (#41214046)
The number of people who start checkout and the number of people who check out are different, and I think that was what they meant
Re:A/B testing mistakes I learned the hard way by gregbarbosa on Monday August 19, 2024 @11:42AM (#41291992)
> But what else is there to measure other than checkout button click count(and follow up purchases) to measure the effect of button color change?

Purchases occur on the checkout page itself. Its design, payment input, and upsells can all impact results, potentially counteracting the button color's effects. You need a clearer hypothesis to address these.