Re:Cheating in Atlanta: A Teachable Moment
by bsder on Thursday April 09, 2015 @08:37PM
(#9351943)
Using tests for an "objective measure" is doomed on its face. That's gigantic sign that the people involved are more interested in blame transfer than in progress.
You can use tests for trends. That's a good use of tests. You can use tests for feedback to the individuals directly involved. That's also a good use of tests.
This corresponds to my "software metrics" points. If I suddenly see an uptick in average lines of code committed, I should take a look. If I start seeing a big increase in bugs filed, I should take a look and see what just happened. Most of the time, there's a good explanation. Sometimes, someone is doing something stupid and I need to go fix that. And, rarely, someone is doing something malicious and needs to be fired.
Tests should be used as an indicator to a human to "look here!" However, test results are simply an indicator to a human to exercise judgment--not an objective measure to remove humans from the loop.
The problem with education is that people really don't want to use the tests as "indicators". As in the article I pointed out, that particular school now is having a decrease in results--the tests are indicating with a big, red klaxon that something is going wrong. People should be examining the situation with a magnifying glass to figure out the issues and fix them.
The problem is that "something going wrong" is very clear--a new principal and new directives from the head bureaucrats. Do you think that they will look at the test results and say "Oh, we need to undo these policies and get a new principal?" Unlikely.
Would you like a metric that only ever gets used against you but that your management gets to ignore? Of course not. It's why the complaints by programmers about management are legion.
And that's why teachers hate all this stuff. Somehow, it only ever gets used against the teachers. When the evidence points at the administrators, school board or politicians, it gets ignored.
This isn't even limited to teachers. Physicians oppose the collection of this kind of data about outcomes for the sames reasons--it will very quickly get turned into a ranking system that gets used against doctors rather than for improving outcomes.
You can use tests for trends. That's a good use of tests. You can use tests for feedback to the individuals directly involved. That's also a good use of tests.
This corresponds to my "software metrics" points. If I suddenly see an uptick in average lines of code committed, I should take a look. If I start seeing a big increase in bugs filed, I should take a look and see what just happened. Most of the time, there's a good explanation. Sometimes, someone is doing something stupid and I need to go fix that. And, rarely, someone is doing something malicious and needs to be fired.
Tests should be used as an indicator to a human to "look here!" However, test results are simply an indicator to a human to exercise judgment--not an objective measure to remove humans from the loop.
The problem with education is that people really don't want to use the tests as "indicators". As in the article I pointed out, that particular school now is having a decrease in results--the tests are indicating with a big, red klaxon that something is going wrong. People should be examining the situation with a magnifying glass to figure out the issues and fix them.
The problem is that "something going wrong" is very clear--a new principal and new directives from the head bureaucrats. Do you think that they will look at the test results and say "Oh, we need to undo these policies and get a new principal?" Unlikely.
Would you like a metric that only ever gets used against you but that your management gets to ignore? Of course not. It's why the complaints by programmers about management are legion.
And that's why teachers hate all this stuff. Somehow, it only ever gets used against the teachers. When the evidence points at the administrators, school board or politicians, it gets ignored.
This isn't even limited to teachers. Physicians oppose the collection of this kind of data about outcomes for the sames reasons--it will very quickly get turned into a ranking system that gets used against doctors rather than for improving outcomes.