News for hackers. Stuff that matters.
Re:How to Make Easy & Flexible Star Ratings by mhartl on Friday October 14, 2011 @03:02PM (#3112458)
This is a great discussion of the mechanics of rendering star ratings in a browser. I'd love to see a companion theory post on how to intelligently compute and rank such ratings. The arithmetic mean is notoriously sensitive to outliers, and the consequences are sometimes severe: I know a resort in Thailand that used to be ranked #1 on TripAdvisor on its island (Koh Phangan), only to fall to #17 after a 1-star review. (The tragedy is that, if you read the review, it's clearly positive—the reviewer evidently thought that 1-star was best. D'oh!) In addition, any sensible ranking should take into account statistical significance, so that (say) a 4.6 ranking consisting of 45 reviews (possibly) gets ranked above a 5-star ranking consisting of one review. How does Airbnb handle these cases, or does it just punt by calculating and sorting the arithmetic mean?
Re:How to Make Easy & Flexible Star Ratings by gwillen on Friday October 14, 2011 @03:17PM (#3112531)
Re:How to Make Easy & Flexible Star Ratings by samstokes on Friday October 14, 2011 @06:51PM (#3113258)
Also the response article at http://masanjin.net/blog/how-to-rank-products-based-on-user-... is interesting.
Re:How to Make Easy & Flexible Star Ratings by BerislavLopac on Saturday October 15, 2011 @03:21AM (#3114337)
Thank you guys, I'm just working on an app that requires calculating scores on user input, and these articles are pure gold! :)
Re:How to Make Easy & Flexible Star Ratings by starwed on Friday October 14, 2011 @03:31PM (#3112603)
Seems like a site with lots of heavily rated products could do a bit better -- you might be able to use your database of known distributions to inform your prior.
Re:How to Make Easy & Flexible Star Ratings by nazar on Friday October 14, 2011 @05:30PM (#3113039)
I am super surprised by your comment, because thats exactly the question I asked my friend yesterday. I am trying to implement a ranking system on my website, so I asked my more experienced friend about it and he recommended me one book: Programming Collective Intelligence Building Smart Web 2.0 Applications by Toby Segaran, O'Reilly

http://shop.oreilly.com/product/9780596529321.do

Re:How to Make Easy & Flexible Star Ratings by Robin_Message on Saturday October 15, 2011 @03:31AM (#3114353)
I just got that off my shelf, and page 25 says to use the arithmetic mean. I can't see anywhere where it talks about outliers or better averages.
Re:How to Make Easy & Flexible Star Ratings by nkurz on Friday October 14, 2011 @05:23PM (#3113010)
There's some good discussion of one approach here: http://news.ycombinator.com/item?id=3046785
Re:How to Make Easy & Flexible Star Ratings by ajtaylor on Friday October 14, 2011 @11:01PM (#3113835)
Thanks to the above comments for all the links! I'm about to start on a new project at $work, for which I think those postings will be very useful.