Re:How Not to Sort by Average Rating (2009)
by paulgb on Wednesday August 30, 2017 @06:00PM
(#15136458)
Good answer, this has a nice property that it can be applied to any reasonably behaved average-based system to get an honest mechanism. For a plain average it is equivalent to the median.
[ Parent
| on HN ]
Re:How Not to Sort by Average Rating (2009)
by ajennings on Wednesday August 30, 2017 @06:56PM
(#15136814)
Not actually equivalent to the median.
If all the scores are 1s and 5s, then the median will be a 1 or a 5, but the average will be somewhere in between.
The problem is slightly easier to understand if we consider the grading scale from 0 to 100. Then every agent, trying to manipulate the score as much as they can toward their "ideal grade", will submit a grade of 0 or 100.
The average will converge to the unique number, X, where X percent of the graders want the final grade to be above (or equal to) X.