News for hackers. Stuff that matters.
Re:MIT to no longer consider SAT subject tests in admissions... by knzhou on Friday March 20, 2020 @05:38PM (#22641924)
Wow, this is a remarkable level of gaming that I never was aware of!

> - Within the grammar questions, Choice (e) "None of the above" is 99% of the time NEVER the answer.

> - The math questions will usually have (1) answer that is an outlier. 95% of the time, this is not the correct answer; (2) will be similar to the correct answer in different ways; and (1) will be the correct answer

This is exactly the reason that, when I design tests, I strive to make "none of the above" or the outlier answer the correct one about 20% of the time. I really hope the SAT writers are doing that now.

> ALL sections (and sub-sections) have questions that strictly increase in difficulty / projected "miss-rate" as time goes on.

The computerized GRE goes even further... it's like a videogame, it feeds you harder questions the better you do, then reverts to easier ones when you mess up.

Re:MIT to no longer consider SAT subject tests in admissions... by fyz on Friday March 20, 2020 @05:51PM (#22642014)
> The computerized GRE goes even further... it's like a videogame, it feeds you harder questions the better you do, then reverts to easier ones when you mess up.

Isn't that one of the better ways to finely calibrate a score? Rough approximation of heapsort?

Re:MIT to no longer consider SAT subject tests in admissions... by knzhou on Friday March 20, 2020 @05:58PM (#22642069)
Yes, it definitely is!

It does feel a little crazy, though, when suddenly all the vocab words are like, "tergiversate" and "pulchritudinous". And then when you get them all wrong it's back to "the cat sat on the mat". :P

Re:MIT to no longer consider SAT subject tests in admissions... by thebradbain on Friday March 20, 2020 @05:43PM (#22641957)
I completely agree, and as much as I hate CollegeBoard hope they've done more to reinvent their tests, as I do think objective measurement of some kind does have a place in admissions, even though perhaps as not the end-all-be-all it used to be.

I used to be semi-adjacent to that sphere, but I do not know anything about the current format of the tests other than what is published.

Re:MIT to no longer consider SAT subject tests in admissions... by walshemj on Friday March 20, 2020 @06:21PM (#22642274)
Yes you need to learn to look for the distractors and rule them out