News for hackers. Stuff that matters.
Re:'A Test You Need to Fail': A Teacher's Open Letter to Her... by yummyfajitas on Saturday March 24, 2012 @10:23AM (#3749428)
Do they identify bad schools? Or do they identify schools with children that are harder to teach?

Test results are a measurement of how well educated the student is at a point in time. That's all.

You can measure the effect of a school by studying value added - how well a student performs after education compared to how well they performed before. Or similarly, how well a student performs compared to statistically similar students.

You can determine that some subsets of students are harder to teach by correlating observable characters (parental income, race, gender, etc) with outcomes.

Re:'A Test You Need to Fail': A Teacher's Open Letter to Her... by acdha on Saturday March 24, 2012 @01:17PM (#3749927)
Everything you mention is technically possible but it's unclear that they are actually well used, with considerable evidence (see NYC's recent data release) that the numbers are used by people who are completely unprepared to work with complex data.

Even the value add comparisons are hard to draw correct conclusions from without more context: a student shows no improvement in math. Did they have a bad teacher, an attendance problem or was it something like being an ESL student who has never received the help needed to understand their classes? That's not the kind of analysis which happens when the tests are effectively a single number which determines careers.

Re:'A Test You Need to Fail': A Teacher's Open Letter to Her... by DanBC on Saturday March 24, 2012 @11:24AM (#3749579)
So, carefully used, with a statistician doing analysis, they're useful.

How often are they carefully used, with an honest statistician doing the analysis, and without politicians / reporters / etc mangling the numbers?

Re:'A Test You Need to Fail': A Teacher's Open Letter to Her... by yummyfajitas on Saturday March 24, 2012 @11:37AM (#3749604)
Tell you what - lets eliminate all government accountability, since we can't avoid politicians/reporters/etc mangling things. End the FOIA, CBO, GAO, etc? Shut down thomas.loc.gov, and stop reporting the federal budget?

Or maybe we can accept that nothing is perfect, and stop letting perfection be the enemy of the good.

Re:'A Test You Need to Fail': A Teacher's Open Letter to Her... by DanBC on Saturday March 24, 2012 @11:46AM (#3749626)
There's a difference between something being "not perfect but useful" and something being "not perfect and harmful".

Since there's very little research on the benefits or disadvantages of constant testing it's surprising that people are happy to spend so much time and money on it.