News for hackers. Stuff that matters.

A comment on Scott's Cheap Flights: Growing a small side project into a booming business. Parent comment

Re:Scott's Cheap Flights: Growing a small side project into ... by napworth on Friday June 30, 2017 @11:59AM (#14671553)
In most cases, A/B testing will actually do negative damage than if you didn't test it at all.
[ Parent | on HN ]
Re:Scott's Cheap Flights: Growing a small side project into ... by jpster on Friday June 30, 2017 @12:12PM (#14671650)
Depends on if the tester actually knows what they're doing. https://blog.kissmetrics.com/your-ab-tests-are-illusory/
[ Parent | on HN ]
Re:Scott's Cheap Flights: Growing a small side project into ... by ssharp on Friday June 30, 2017 @12:17PM (#14671682)
In most cases, flying a plane yourself will result in more negative damage than having a trained pilot fly you.
[ Parent | on HN ]
Re:Scott's Cheap Flights: Growing a small side project into ... by ssharp on Friday June 30, 2017 @12:16PM (#14671673)
Interested in further thought here.
[ Parent | on HN ]
Re:Scott's Cheap Flights: Growing a small side project into ... by jdpedrie on Friday June 30, 2017 @12:07PM (#14671612)
[citation needed]
[ Parent | on HN ]
Re:Scott's Cheap Flights: Growing a small side project into ... by eddigo on Friday June 30, 2017 @12:07PM (#14671613)
And I would bet in a large subset of those cases it's because the person implementing those tests and the person interpreting the results aren't the same. And that neither understands basic statistical hypothesis testing.
[ Parent | on HN ]