News for hackers. Stuff that matters.
Re:Why App Speed Matters: Revenue by sokoloff on Wednesday June 28, 2017 @10:41PM (#14660371)
About 5 years ago, I undertook a significant web performance effort on an IR top 100 e-commerce property. We sped the site up significantly and, being the good data nerds that we were, split-ran the hell out of it and found a zero-point-zero (sub-noise) difference in average session value, conversion rate, and average order value.

Believing those then 5-year old studies, we went in the opposite direction and intentionally slowed the site down in multi-variate testing. Out to 1000ms of intentional slowdown per dynamic page, we saw zero-point-zero change in ASV, CR%, and AOV.

We kept the faster experience, because "hey, why not?" and we'd paid all the NRE for it anyway, but the project was a technical success but a big bust versus business case.

Re:Why App Speed Matters: Revenue by gingerlime on Wednesday June 28, 2017 @11:52PM (#14660630)
That's really fascinating! What about things like Google ranking that's supposedly also affected by page speed? (Or maybe it's not? I have a very limited SEO knowledge)
Re:Why App Speed Matters: Revenue by hayksaakian on Thursday June 29, 2017 @12:37AM (#14660815)
it's only really affected from a negative perspective (think: so slow that google can't crawl your website or load it).

Anything faster than 2-3 seconds has very diminishing if not 0 returns.

Re:Why App Speed Matters: Revenue by mrkurt on Wednesday June 28, 2017 @11:40PM (#14660585)
That's actually really interesting. I'd love to know more!
Re:Why App Speed Matters: Revenue by EGreg on Thursday June 29, 2017 @03:30AM (#14661439)
Actually that's an interesting takeway.

Before working hard to optimize speed, if you have a working site, try slowing it down and seeing if that makes a difference!

Re:Why App Speed Matters: Revenue by sokoloff on Thursday June 29, 2017 @08:27AM (#14662657)
Agreed (naturally), but also be aware that the relationship may not be linear. There is quite possibly a "knee" in the curve where faster than some threshold will all be the same.

However, it's a quite easy test to run, so may be worth doing even if you can't stake your life on the results applying to a hypothetical speedup.

Re:Why App Speed Matters: Revenue by jlg23 on Thursday June 29, 2017 @05:33AM (#14661871)
You don't mention the name of the company, but may I ask whether they were selling goods in the same price range?

I am asking because I can imagine that people who are looking for a $5 item are more inclined to abort the search if it feels to slow while I assume someone looking to buy a $1000 item will persist.

Re:Why App Speed Matters: Revenue by sokoloff on Thursday June 29, 2017 @06:46AM (#14662153)
It was vistaprint, so item pricing is similar ($5-50 typically). The confounding issue is that because everything we sell is customized by our customers, they may be less sensitive to small differences in page speed. (If it takes 15.5 minutes instead of 15 minutes to design a business card end-to-end, maybe that matters less than a web or product search.) This was also 5-years ago, so our mobile experience was very much limited to order/account inquiry and everything else we steered you heavily back to desktop.

Our analysis (for this project) was also limited to session and repeat session analysis, so we would have excluded any effects related to long-run increases in sessions from distinct shoppers (organic search traffic increase or cross-shopper recommendations). I believe those were small enough to properly ignore.

I'm definitely not arguing that page speed is bad, but do question the gospel that every 100ms is worth X% more traffic and conversions.