News for hackers. Stuff that matters.
Re:Will This Be The New Google Web Design? by michael_dorfman on Monday April 19, 2010 @08:08AM (#1276520)
I wonder what metric Google uses as a proxy for "conversion" in their A/B testing-- page views? Length of time on site? Ads clicked?
Re:Will This Be The New Google Web Design? by timcederman on Monday April 19, 2010 @04:31PM (#1277766)
Position of result clicked (including ads) Number of result clicks per session (including ads) % of sessions with 0 results % of sessions with no click-through etc.
Re:Will This Be The New Google Web Design? by moultano on Monday April 19, 2010 @03:51PM (#1277655)
Pretty much every statistic you can imagine gets tracked. The interesting thing is how they are used. Time on site is a negative signal for instance.
Re:Will This Be The New Google Web Design? by stingraycharles on Monday April 19, 2010 @11:41AM (#1276938)
IMHO there would be only one thing that makes sense: money earned.
Re:Will This Be The New Google Web Design? by michael_dorfman on Monday April 19, 2010 @11:46AM (#1276957)
And how would they A/B test for that, exactly?

Obviously, that's what they are interested in, in the long run-- but to test design changes, they need a more specific (and easily measurable) metric. And, no doubt, they have one. I just don't know what it might be.

Re:Will This Be The New Google Web Design? by inerte on Monday April 19, 2010 @12:36PM (#1277104)
They have several.

To answer your question, if I was to pick up only one, the first that came to my mind was "pageviews". So, everything that increases pageviews is good. Well, not quite, because so is CTR, and in fact doubling CTR allows you to halve pageviews.

Anyway, whatever they think of, the ultimate step is money earned. No single path leads to this, but several, like pageviews, CTR, click value, searches per day, other services integration, etc...

Edited: You're thinking about A/B testing but I don't know if you're aware there's also multivariate testing, which Google does use (its optimizer easily creates A/B and multivariate).

Re:Will This Be The New Google Web Design? by gmurphy on Monday April 19, 2010 @08:22PM (#1278239)
This is the thought process and slippery slope that leads to sites like experts-exchange - with a large userbase, it's easy to create and demonstrate changes that result in bags of money in the medium term, yet destroy the long-term value and usage of your site.