News for hackers. Stuff that matters.
Re:Kayak's Most Interesting Mobile A/B Test by raldi on Tuesday March 11, 2014 @03:55PM (#7381713)
Can someone give a summary of what the A/B test was and why it was interesting?
Re:Kayak's Most Interesting Mobile A/B Test by pwenzel on Tuesday March 11, 2014 @04:01PM (#7381749)
The second paragraph of the article is paired with screenshots that document the test very clearly. Here's a summary:

1. Kayak added a small message saying "SSL/TLS encrypted payment" to the bottom of the form.

2. In Kayak's test, people tended to book less when the message was not included.

3. According to the interview, this contradicts what other people on the internet say.

4. Conclusion: "Just because something worked for someone else doesn’t mean it will work for all apps. You have to try it out yourself."

Re:Kayak's Most Interesting Mobile A/B Test by rralian on Tuesday March 11, 2014 @06:25PM (#7382623)
I think the crux of the question is why this was so interesting, and I would say it's just not. It wasn't surprising or interesting.
Re:Kayak's Most Interesting Mobile A/B Test by toastedzergling on Tuesday March 11, 2014 @05:32PM (#7382299)
Sure, I suppose I am qualified to chime in here, after all, I'm a developer for an A/B testing company (but not the one posted here-apptimize).

A/B Testing is a bit of a catch-all phrase for "testing the effectiveness of website changes." Strictly Speaking, A/B only refers to the testing specifically is testing of one change "A" against another "B". You can have multi-variate testing as well where you add in a third group "A,B, or C", or mixtures "ABC vs AB vs AC vs BC vs CONTROL"... it's up to the test design.

But basically it's a tool to help you see if the changes you make to your website will work, while the website is up running, using real users. So, for example:

* If your goal is to get more downloads, maybe you'll tset some page layouts or images and see which test group clicks the download button more

* Or, See which splash page results in the most "Sign up for Newsletter" clicks

This is great information for marketers, or really testing out any old thing you want that is trackable through browser-events.

Really though, this is just the tip of the Iceberg of what is possible... but I'll leave it at that. If you really want to know more let me know.

Re:Kayak's Most Interesting Mobile A/B Test by isleyaardvark on Tuesday March 11, 2014 @03:58PM (#7381732)
They tested an "SSL/TLS encrypted payment" message underneath "Agree & Book" on mobile. Another site removed that and increased conversions, but the opposite was true for Kayak - it helped.