News for hackers. Stuff that matters.

A comment on Netflix Pulls the Plug on Feature Designed to Get Kids Addicted to Netflix. Parent comment

Re:Netflix Pulls the Plug on Feature Designed to Get Kids Ad... by avip on Monday December 24, 2018 @09:12PM (#18755441)
I'd assume #num_customer_complaints is not part of the A/B metrics. If people complain but don't follow through with actions A/B probably should ignore it.
[ Parent | on HN ]
Re:Netflix Pulls the Plug on Feature Designed to Get Kids Ad... by rhizome on Monday December 24, 2018 @10:53PM (#18755794)
I'm not an MBA, but I imagine there's something where if you wait until you know for a fact that customers are leaving for specific and known reasons, you're waiting too long to fix it.
[ Parent | on HN ]
Re:Netflix Pulls the Plug on Feature Designed to Get Kids Ad... by annadane on Monday December 24, 2018 @09:23PM (#18755478)
Yeah but the thing is A/B testing shouldn't be "rely exclusively on it and then completely ignore feedback after it's been rolled out"
[ Parent | on HN ]
Re:Netflix Pulls the Plug on Feature Designed to Get Kids Ad... by cortesoft on Tuesday December 25, 2018 @12:25AM (#18756071)
What if they follow through with it 6 months or a year later? Your a/b metrics won't catch long term effects. Maybe a change gets people more engaged short term, but drives them away long term.
[ Parent | on HN ]