News for hackers. Stuff that matters.

A comment on Judge Rules US v. Google Trial Documents Can Be Posted Online. Parent comment

Re:Judge Rules US v. Google Trial Documents Can Be Posted On... by Fluorescence on Wednesday September 27, 2023 @04:06PM (#37680523)
> ablation experiment

What is that? "Ablation" as in removal? Do they AB test removing new features just for data? ... and also monitor SM threads for feedback?

[ Parent | on HN ]
Re:Judge Rules US v. Google Trial Documents Can Be Posted On... by hyeonwho22 on Wednesday September 27, 2023 @04:34PM (#37680891)
In AI research ablation experiments are comparative tests, but in one branch some feature is removed. Here the Chrome team is saying that removal of the feature (which the Ads team wanted) was instantly noticed by users.
[ Parent | on HN ]
Re:Judge Rules US v. Google Trial Documents Can Be Posted On... by Atsuii on Wednesday September 27, 2023 @04:54PM (#37681161)
Yes ablation as in removal. They then refer to using the 3% experiment to estimate out revenue loss, so it appears they were running an AB test where it was removed for 3% of users so they could understand the metric impact of removal. Part of being a decent PM is monitoring SM for any feature talk.
[ Parent | on HN ]