Re:How Measurement Fails Doctors and Teachers
by ptaipale on Monday January 18, 2016 @02:37AM
(#10923100)
> If gaming the metric is a useful behavior, the metric is useless.
That is exactly why you should have a review of how a metric might be gamed, before you accept to use a this metric.
Re:How Measurement Fails Doctors and Teachers
by danieltillett on Monday January 18, 2016 @02:30AM
(#10923081)
Yes this is 100% true, but the point I was making is if the test writes think first about how the metric can be gamed then they can take action to prevent the gaming including changing the metric and test.
Secondary infections in hospitals is a good metric. If you game it, it's still a net win for everybody.
Pass rates in schools is a bad metric. I can improve my metric by getting my lowest students to quit.
Rather than trying to "anti-game" a metric, simply observe if the metric is being gamed. If it is, the metric is a priori bad and should be removed.