Re:MIT to no longer consider SAT subject tests in admissions...
by thaumasiotes on Friday March 20, 2020 @02:18PM
(#22639942)
Yes, no one disputes that memorizing an answer key can give you a higher score. But by the same token, no one believes that the influence of cheating is of interest when studying potential gains from "test prep".
[ Parent
| on HN ]
Re:MIT to no longer consider SAT subject tests in admissions...
by seanmcdirmid on Friday March 20, 2020 @02:24PM
(#22640030)
That isn’t just it though: they have access to old tests, they have access to test takers who memorize questions, given the importance and popularity of any test, these options will arise and people with means will have access to them.
There is no avoiding Goodhart’s law.
Re:MIT to no longer consider SAT subject tests in admissions...
by thaumasiotes on Friday March 20, 2020 @02:34PM
(#22640194)
You can make a case for a much weaker form of Goodhart's Law, that with the SAT as a well-known target, SAT scores are less informative than they would be otherwise.
But "there is no avoiding Goodhart’s law" is obviously wrong if you interpret Goodhart's Law as it's actually phrased; the SAT is doing a fine job of avoiding it today. The SAT hasn't ceased to be a good measure. It's still very informative.