A/B testing gets misused to juice metrics in the short term

Re:A/B testing gets misused to juice metrics in the short term by teakettle42 on Tuesday July 12, 2022 @10:55AM (#32070901)

Apple unequivocally does not do active A/B testing on their users by changing applications or the operating system out from under them.

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by selfhoster11 on Tuesday July 12, 2022 @12:44PM (#32072518)

It's almost like they use a dedicated focus/beta testing group or something, instead of making all their users join in.

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by daniel_reetz on Tuesday July 12, 2022 @04:20PM (#32075119)

I can't think of an Apple engineer who would make such a definitive statement on behalf of the company, in public. I also can't think of anyone working there who would have definitive knowledge across all apps and software, because disclosure would prevent such knowledge.

Apple introduced A/B testing to Testflight in 2017 and more A/B testing to the App store this year.

Source: I worked at Apple, but not in software.

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by izacus on Wednesday July 13, 2022 @06:05AM (#32080706)

Great, but what exactly does that mean for this conversation and how users percieve Apple products?

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by mrkstu on Tuesday July 12, 2022 @11:09AM (#32071088)

Yep- it does this in betas, but not in production apps.

[ Parent | on HN ]