News for hackers. Stuff that matters.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by patio11 on Thursday March 18, 2010 @11:43AM (#1201560)
This is the frightening reality of what happens when you have a large business where everything scales multiplicatively and then you make a trivial change which is net-beneficial. People want this to be impossible because it strikes you as intuitively wrong that five minutes of work could be worth eight figures. Reality doesn't care what you think, though.

Relatedly, and more prosaicly, if you average one successful A/B test with a 5% lift per month, and you do nothing else, your business will grow at about 80% per year. Multiplicatively effective businesses are a wonderful place to be in life.

Then I look over at Zynga at all where you can do multiplicative effectiveness within the context of a viral loop, which is just so effective I'm almost certain it goes against my religion somehow.

Re:Microsoft attributes $80-$100 million dollars in revenue ... by axod on Thursday March 18, 2010 @12:16PM (#1201661)
That all sounds very deep for something I think it a lot simpler.

  1. They tried some weird colors. Didn't work well
  2. They thought "screw it" and copied the colors Google use. (Give or take)
  3. Users feel more 'at home' and maybe even assume the
     results are from Google.
You can't replicate that situation. You can't copy the colors Google uses again. I guess you can make Bing even more like Google, but only up to a point.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by chaosmachine on Thursday March 18, 2010 @12:37PM (#1201727)
I suspect you're right on. The rest of this story is just some made-up huge number that would get people talking about Bing.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by OmarIsmail on Thursday March 18, 2010 @02:34PM (#1202086)
Also, this 'trivial' change isn't so trivial. The actual change itself is relatively minor, however the infrastructure required to perform proper testing, analysics, etc is huge. Not to say the the large number of users required to do proper testing quickly. These huge number of users are a result of decades of MS' brand, multi-million dollar marketing campaigns, etc etc.

Kind of like how it takes a lifetime to be an overnight sensation.

Re:Microsoft attributes $80-$100 million dollars in revenue ... by naner on Thursday March 18, 2010 @09:33PM (#1203071)
> if you average one successful A/B test with a 5% lift per month, and you do nothing else, your business will grow at about 80% per year.

Aren't there too many variables? How do you know the increase isn't just a correlation?

Re:Microsoft attributes $80-$100 million dollars in revenue ... by fierarul on Thursday March 18, 2010 @11:55AM (#1201604)
Don't take this the wrong way but on every comment I've read from you, there is "A/B" :-)

Not sure how Zynga's effectivness might be against your religion, but "A/B" is part of you somehow: religiously or not.

Re:Microsoft attributes $80-$100 million dollars in revenue ... by MaysonL on Thursday March 18, 2010 @03:46PM (#1202301)
A/B = the core of the scientific method.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by fierarul on Thursday March 18, 2010 @05:48PM (#1202614)
Not so sure about that...

It looks to me that A/B leads quite easily to a local optimum.

But it's better than no method at all.

Re:Microsoft attributes $80-$100 million dollars in revenue ... by DaniFong on Thursday March 18, 2010 @04:16PM (#1202377)
80% per year outpaces Moore's law, btw.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by nopassrecover on Thursday March 18, 2010 @05:53PM (#1202622)
Moore's law isn't about business growth.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by DaniFong on Thursday March 18, 2010 @06:59PM (#1202787)
No, it's about growth, in general.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by nopassrecover on Monday March 22, 2010 @12:36AM (#1209367)
No, it's about the number of transitors on an integrated circuit and the resulting computational power.
Re:Microsoft attributes $80-$100 million dollars in revenue ... by DaniFong on Tuesday March 23, 2010 @08:20PM (#1214492)
If one takes the narrow view, yes.