News for hackers. Stuff that matters.

A comment on Whom the Gods Would Destroy, They First Give Real-Time Analytics (2013). Parent comment

Re:Whom the Gods Would Destroy, They First Give Real-Time An... by jbreckmckye on Monday October 02, 2017 @04:02AM (#15382331)
> But of course if you've done any real world AB testing, much less any statistics training, you should already know that.

Are most product managers and designers running multivariate tests thus trained? My experience has said 'no'.

In fact, if there's one error I see companies making again and again, it's confusing customer signal from user noise.

I do agree with the rest of your comment however.

[ Parent | on HN ]
Re:Whom the Gods Would Destroy, They First Give Real-Time An... by nerfhammer on Monday October 02, 2017 @12:06PM (#15384953)
If the people running experiments do not know and cannot be told how to do the fundamental thing that they are trying to do, then you have bigger problems.

Which is ultimately what this post points to: the author doesn't trust his team and isn't listening to them and doesn't expect they will listen to him. Regardless of the degree to which the author is correct in his assumptions, the problem is more than just engineering.

[ Parent | on HN ]