Re:Benefit Layers: How to avoid sales fluff in devtools
by ilrwbwrkhv on Thursday July 13, 2023 @08:22PM
(#36717888)
You might not get statistic significance if your numbers are low when first starting out.
Re:Benefit Layers: How to avoid sales fluff in devtools
by swyx on Thursday July 13, 2023 @08:22PM
(#36717897)
the problem is 1) sample sizes are very low for early startups 2) feedback loops (esp for higher ACV) are long, sometimes >1 year.
you still need principles to drive at the end of the day
Re:Benefit Layers: How to avoid sales fluff in devtools
by alphager on Friday July 14, 2023 @06:39AM
(#36722031)
I don't think that A/B tests work for things that enterprises buy. The normal workflow is
1. Dev visits the site, gets convinced that he wants the tool.
2. Dev convinced management to allow the expense.
3. Dev visits the site and buys the tool.
You want to test step 1 but only get data for step 3, where the content of the site is completely irrelevant.
It might be the case that we think we want no fluff, but we're actually swayed more by fluff.