Re:A/B testing gets misused to juice metrics in the short term
by tnolet on Tuesday July 12, 2022 @11:51AM
(#32071706)
We checked our Intercom. We spammed. One user got six emails in a 5 day span. There were some separate initiatives going on. We didn't check the settings and current outgoing mail. We will change it.
BTW: all of this was done without any bad intent. It's 100% us being stupid and not coordinating and being diligent enough.
Re:A/B testing gets misused to juice metrics in the short term
by sonofhans on Tuesday July 12, 2022 @05:36PM
(#32075998)
This is such an impressive series of responses. I know some folks are flipping you shit here, but I’ve seen a lot of people try to “engage” with customers, in HN and elsewhere, and I think you’ve done it really nicely. You sound like a human; you admit mistakes; you follow up. Good on you.
Re:A/B testing gets misused to juice metrics in the short term
by tpoacher on Tuesday July 12, 2022 @01:10PM
(#32072922)
Send a seventh to apologize! /s
(on a serious note, good on you for taking action though. +1)
Re:A/B testing gets misused to juice metrics in the short term
by stalfosknight on Tuesday July 12, 2022 @12:27PM
(#32072277)
You only get one chance to make a first impression.
1. Why our fancy expensive mailing/marketing tool (Intercom) does not spread these messages in a relaxed fashion (it should)
2. If of those five messages, maybe two were the obligatory "confirm your email" and standard "Welcome to Checkly, this is what we do"
TL;DR we should not spam.