Just eyeballing that, can you pick the most critical time for me to have checked conversion rates in the last year? (It might -- and I stress might -- have saved me $3.5k.)
2) I think humans are exceptionally good at retrofitting explanations to data, even when the explanation and the data are unrelated.
3) Rather than continually reacting to minor changes in the conversion rate, deceiving myself as to their cause, and then implementing something that probably doesn't matter, I'd rather schedule this sort of work as part of a process: write A/B test, check conversions (with all extraneous sources of noise filtered out), implement winning alternative as appropriate, get back to work.
I disagree, strongly.
1) It is highly likely your conversion rate will bounce around without regard to what you're doing.
http://images1.bingocardcreator.com/blog-images/hn/conversio...
Just eyeballing that, can you pick the most critical time for me to have checked conversion rates in the last year? (It might -- and I stress might -- have saved me $3.5k.)
2) I think humans are exceptionally good at retrofitting explanations to data, even when the explanation and the data are unrelated.
3) Rather than continually reacting to minor changes in the conversion rate, deceiving myself as to their cause, and then implementing something that probably doesn't matter, I'd rather schedule this sort of work as part of a process: write A/B test, check conversions (with all extraneous sources of noise filtered out), implement winning alternative as appropriate, get back to work.