Re:Nvidia Announces A100 80GB GPU for AI
by laichzeit0 on Wednesday November 18, 2020 @11:07PM
(#25146130)
I doubt it’s A/B testing, more likely some multi-armed bandit algorithm.
Re:Nvidia Announces A100 80GB GPU for AI
by disgruntledphd2 on Thursday November 19, 2020 @06:04AM
(#25148286)
You typically need both.
You'll have some kind of MAB in production, but in order to measure individual incremental impacts, you still need a proper experiment.
Not really, they make a shit ton of money from their recommendations and perform extensive A/B testing to keep track of how much money it makes them. Anecdotes aren't data and large tech companies don't spend money for no reason (especially when they can A/B test the impact trivially). Remember that at their scales even a 0.01% increase in revenue is worth $10+ million per year so they don't need to be perfect to make a shit ton of money. There's a reason ML engineers get paid $1+ million and it's not corporate stupidity.