But yet I'm judged on the small slice of that overall pie that I can control.
What this study indicates is that there are teachers who can reproducibly create success levels given the control of the situation that they do have.
How is it any different than the rest of the working world where you can control some things and you can't control others yet your job is to do the best you can with what you can control?
This was an Algebra class, and the students had to be graded on their Algebra skills and judged on their Algebra proficiency tests. No homework would be completed, and no recourse could be given for lack of homework. 50% of these 9th grade students will not make it graduation. 3% will make it to a four year institution. Less will graduate from there.
How is this different than working with professional engineers? Ones who could be fired or in some other way worked with? How is this different than working code where a solution exists? How is this different than working with other people who are looking for a solution as well?
A better comparison would be to how you judge a prison guard in relation to recidivism rate.
Whether standardized tests have a role in answering that question or in evaluating teacher performance is hotly debated right now.
But the purpose of my original post was to draw attention to a different question: How can society as a whole ensure that every child gets the best education possible?
In schools that have no problem attracting resources, great teachers, and children with mostly fortunate backgrounds, perhaps this second question can be answered by asking the first: how can we improve our teachers?
But in schools that lack resources, whose students live in abuse, poverty, and despair, what even an exceptional teacher can do will be radically limited, and society would probably be better off focusing on how to eradicate poverty -- the real cause behind the failure of too much education in this country.
Unfortunately, seriously tackling the issue of poverty is much harder (and even contrary to some dominant American ideologies) than simply demanding more standardized tests be given and blaming teachers and their unions.
I know that the funding the schools get is blamed for a lot of their problems, and I understand where people who talk about how hard it is to teach kids with behavioral issues and histories of abuse are coming from.
I sympathize, but I also think that's a cop-out. I had bad teachers in both places. In Winthrop, I had horrible teachers. They took away advanced classes because an outside contractor thought it created elitist attitudes and putting smart kids in the regular classes would boost overall performance.
I had science teachers that just had us play with legos all day and gave A's to all the basketball players. I had math teachers that would lose assignments and blame the students. These were not well-meaning teachers that just had it hard trying to teach these poor kids. These were people that shouldn't have been teaching at all, but could not be replaced.
My parents actually went up to the school a few times to try and talk to the administration and teachers about what was going on. A lot of people did. They got push-back and were asked not to meddle.
There were 2 great teachers there and that's why I didn't completely screw up my life at that point. I've spoken to a lot of people with similar experiences; 1 great teacher that pushed them to be successful. That's why it's so maddening to me when people say that it's not the teacher's fault, that they can't do anything about it. I know that's not entirely what your intent with your post was, but focusing on external environmental issues and bemoaning the poverty of the student body can come across that way.
While poverty is a major issue, and teaching is hard, I don't think you can solve the problems by just changing the student's home environment. You have to change the teachers as well.
Lots of jobs are hard. Doctors have to deal with unruly patients who refuse to change their diet or exercise. Don't they get blamed when their patients don't improve?
Step one, define "best education possible". Step two, learn to measure whether or not a child is getting one (or the closest you can come to it). Step three, maximize some aggregate or regionalized version of your measurements through restructuring of school systems, rewards for good schools and teachers, etc.
The study in this article is just gets us to step two. It looks like you're wanting to discuss step three. That's a different can of worms.
Imagine being a situation where not only did you not have any control over which engineers worked on your team - or even whether they were engineers at all, or even basically literate. Now imagine that your whole industry pretty much worked liked that and that changing from one company to another (which most likely worked the same way) always meant moving cities.
Incidentally, what they did in this study is to measure the value-addition of each teacher, not their raw test scores. Presumably you're not evaluated based on things you have absolutely no control over, as you said - you get judged based on the slice of the pie that you do control.
As an aside, it occurs to me that those teachers who are most effective in underprivileged schools may be totally different than those in wealthier schools.
Why not? Government run education is pathetic. Incentives are all out of whack, there's no competition between teachers or schools that can affect the status quo.
Teachers could use a huge dose of whatever it is that the more competitive business world has to deal with.
Teacher competition, I think, would reduce collaboration. Why give your competitor your secrets to success?
Incentive pay? The problem under this idea is that new teachers are often given the most difficult and unruly of students while more experienced teachers get honors classes. I find this odd because the teachers will the best "tools" for dealing with difficult problems are moved away from those problems.
Then again, the problem is that with any idea for reform, there is a list of reasons why it should not or would not work.
I'm a fan of letting students who are not interested in the academics of school work towards trade school and let those who are academically inclined to work towards university. However, a retired college physics professor friend of mine does not like this solution because he would have been tracked towards trade school and never discovered his love for physics.
Just like you'll see recommended on HN, if you're going to fail, fail early and get on with something that has a chance of working. Our government funded education system is a long painful failure that established forces prevent from being scrapped and reinvented.
Hell, I've only ever fired one engineer in a 20+ year career, and that was because he was the equivalent of a violent student whom you would expel and send to juvi.
Why is it so hard to deal with the information as presented in the study. Fine, question the details or methods of the study. Offer counter evidence. The study presented evidence that good teachers can have a noticeable and measurable level of control on the output of their students. Why is dealing with evidence not the central part of this discussion?
So the argument is that since everyone sucks at measuring things that any arguments about how a particular system of measurement is ineffective should be discarded?
You read something into my argument that I didn't put there, so I'm going to disregard it as a straw man.
I think we can all agree that judging people based on things that they have no control over is not an effective way to evaluate them. This happens in education, as the parent comment outlined. This happens in engineering, as you outlined. It does not follow that teachers should be evaluated in this way, or that a discussion about the problems with this method should not take place.
The study attempted to control for things the teacher's couldn't control. They're actually being differentially judged on the parts of education that they can control.
These lines from the article fly in the face of your entire argument: "They also ranked the teachers using a statistical model known as value-added modeling, which calculates how much an educator has helped students learn based on their academic performance over time".
You would need to address them directly in order to mount a credible counter-argument.
Whenever teacher/school issues come up, it is important to remember that far beyond anything a school or teacher can do, the single-most important factor in a child's education (or their life in general!) is their PARENTS. If a kid has parents who value education, discipline their kids and make time for learning at home, that kid can do just fine no matter what kind of conditions they experience at school. Conversely, it takes a Stand and Deliver-style superteacher to be able to coax success out of a kid growing up in a home where education is not valued and productive personal habits are not modeled.
The biggest problem with education? There are far, far too many parents out there who have absolutely no business raising children at all. We require tests for people to operate a jet ski, but when it comes to absolute power and responsibility for a human child, anybody can do it! That's your right! Don't worry about saddling the rest of society with your child who doesn't stand a snowball's chance in hell of ending up well-adjusted, educated or successful. It's YOUR kid.
I understand that people who are struggling with extreme poverty are often too caught up with bare survival to find the time to focus on their children's educational needs. That is really awful and sad. It is especially sad for their children.
The fact is, as long as society is full of self-centered, thoughtless parents who either fail to understand the basic components of child-rearing or are too busy surviving to care, we will be plagued with students who are going to struggle no matter how great of an educational system they are placed in.
That being said, perhaps the only way to raise a generation of education-valuing, quality parents is to do what we can to create them. So maybe it is best after all to focus on what CAN be done - effective teaching methods for today's teachers. Hopefully a much-improved school system can help raise the prospects of children whose parents are doing nothing to give them a hand up. And then they in turn can become the kinds of nurturing, education-valuing parents that their own children deserve.
Unless the student's parents started abusing them in the year the teacher is being evaluated, it is already accounted for. VAM measures deltas, not absolute levels.
1. How wealthy, poor, educated, or uneducated a child's parents are.
2. How many resources the school and teacher are given.
3. Whether a child's parents are abusing them at home.
4. Whether a child is witnessing violence, hopelessness, despair in their neighborhood.
5. The attitude of a child's family and friends towards education.
6. Whether a child's parents are active in their child's education and in a PTA.
Study after study has shown that these factors greatly influence a child's attention and attitude to school work, their attendance, and ultimately their performance at school.
No child's performance on a standardized test, and no evaluation of a teacher's performance is going to pick up on the above factors, yet they can critically impact how well the child ultimately learns and what the child learns.
Standardized testing of a child that is unfortunate enough to live in a situation where the above factors are against them will likely notice a poorly performing student, one who gradually does worse and worse on the tests until they finally flunk out.
Then, instead of getting extra aid, the funding to the school that has a lot of such children will be cut (thanks to programs like No Child Left Behind), and their teachers penalized.
These factors, which are strongly associated with poverty, are things a given teacher is in no position to influence, but which society as a whole could address. If it has the will.