News for hackers. Stuff that matters.
Re:University Rankings are Awful. Can We Stop Doing the Same... by crazygringo on Tuesday September 10, 2013 @01:41PM (#6361576)
Obviously rankings such as these are highly simplistic, and I think it's pretty obvious that "there is too much noise to say that Yale is better than Princeton".

But sometimes progress can only be made by focusing on "simple" indicators -- things like childhood mortality rates, whether applied to a country or to a single hospital.

For a college to decide it wants to go from #200 to #190 in a particular ranking is meaningless, but going from #200 to #20 is going to be meaningful. Likewise the president of a country saying, "it's atrocious that we're one of the 20 most corrupt, or red-tape-laden, countries" -- it can provide the necessary impetus to change and improvement.

These rankings are certainly not "entirely unsubstantiated" -- they're certainly very far from perfect, but don't throw the baby out with the bathwater.

Re:University Rankings are Awful. Can We Stop Doing the Same... by Aqueous on Tuesday September 10, 2013 @03:08PM (#6362511)
Right. The rankings aren't the last word on an institution. They aren't even close to it. But that doesn't mean they're meaningless. Similarly with countries. These metrics refer to real data corresponding to the actual, real-life experience of people living in these places. If the number of emergency rooms per capita in a country is low, for example, that corresponds to actually higher likelihood that you'll be unable to get to one if you live in that country and are in an emergency situation. The data is real - the author might not like that it seems like a simplistic representation and glosses over a lot of nuances, but then why else do we measure and quantify these trends than to tease out meaningful information from an otherwise incomprehensible, highly complex system?

Even though a single year snapshot of college rankings isn't completely meaningful by itself, you can glean a lot from the movements in the rankings, even with small movements. If a college goes from 200 to 190 in a single year, you can probably determine precisely what changed how by looking at the changes in the internals that they used to derive the number. And sometimes even a small change in ranking does reflect a significant, concrete change in the experience of students attending these institutions.

Similarly, with countries. The dynamics over time of these metrics is what gives this data meaning - not any single ranking.