Re:How to Make Easy & Flexible Star Ratings
by mhartl on Friday October 14, 2011 @03:02PM
(#3112458)
This is a great discussion of the mechanics of rendering star ratings in a browser. I'd love to see a companion theory post on how to intelligently compute and rank such ratings. The arithmetic mean is notoriously sensitive to outliers, and the consequences are sometimes severe: I know a resort in Thailand that used to be ranked #1 on TripAdvisor on its island (Koh Phangan), only to fall to #17 after a 1-star review. (The tragedy is that, if you read the review, it's clearly positive—the reviewer evidently thought that 1-star was best. D'oh!) In addition, any sensible ranking should take into account statistical significance, so that (say) a 4.6 ranking consisting of 45 reviews (possibly) gets ranked above a 5-star ranking consisting of one review. How does Airbnb handle these cases, or does it just punt by calculating and sorting the arithmetic mean?
[ Parent
| on HN ]
Re:How to Make Easy & Flexible Star Ratings
by gwillen on Friday October 14, 2011 @03:17PM
(#3112531)
Use the algorithm given here:
http://www.evanmiller.org/how-not-to-sort-by-average-rating....
Re:How to Make Easy & Flexible Star Ratings
by samstokes on Friday October 14, 2011 @06:51PM
(#3113258)
Also the response article at http://masanjin.net/blog/how-to-rank-products-based-on-user-... is interesting.
Re:How to Make Easy & Flexible Star Ratings
by BerislavLopac on Saturday October 15, 2011 @03:21AM
(#3114337)
Thank you guys, I'm just working on an app that requires calculating scores on user input, and these articles are pure gold! :)
Re:How to Make Easy & Flexible Star Ratings
by starwed on Friday October 14, 2011 @03:31PM
(#3112603)
Seems like a site with lots of heavily rated products could do a bit better -- you might be able to use your database of known distributions to inform your prior.
I am super surprised by your comment, because thats exactly the question I asked my friend yesterday. I am trying to implement a ranking system on my website, so I asked my more experienced friend about it and he recommended me one book:
Programming Collective Intelligence Building Smart Web 2.0 Applications by Toby Segaran, O'Reilly
Re:How to Make Easy & Flexible Star Ratings
by Robin_Message on Saturday October 15, 2011 @03:31AM
(#3114353)
I just got that off my shelf, and page 25 says to use the arithmetic mean. I can't see anywhere where it talks about outliers or better averages.
There's some good discussion of one approach here: http://news.ycombinator.com/item?id=3046785