News for hackers. Stuff that matters.
Re:Gates Foundation study: We’ve figured out what makes a go... by gnosis on Tuesday January 15, 2013 @08:11AM (#5059881)
There are many important factors which teachers (no matter how good they are) can't control:

1. How wealthy, poor, educated, or uneducated a child's parents are.

2. How many resources the school and teacher are given.

3. Whether a child's parents are abusing them at home.

4. Whether a child is witnessing violence, hopelessness, despair in their neighborhood.

5. The attitude of a child's family and friends towards education.

6. Whether a child's parents are active in their child's education and in a PTA.

Study after study has shown that these factors greatly influence a child's attention and attitude to school work, their attendance, and ultimately their performance at school.

No child's performance on a standardized test, and no evaluation of a teacher's performance is going to pick up on the above factors, yet they can critically impact how well the child ultimately learns and what the child learns.

Standardized testing of a child that is unfortunate enough to live in a situation where the above factors are against them will likely notice a poorly performing student, one who gradually does worse and worse on the tests until they finally flunk out.

Then, instead of getting extra aid, the funding to the school that has a lot of such children will be cut (thanks to programs like No Child Left Behind), and their teachers penalized.

These factors, which are strongly associated with poverty, are things a given teacher is in no position to influence, but which society as a whole could address. If it has the will.

Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @08:16AM (#5059898)
And at my job, there are many factors out of my control. I don't control the home life of my engineers. I don't control my customers' decision making processes. I don't control my competitors' actions in the market.

But yet I'm judged on the small slice of that overall pie that I can control.

What this study indicates is that there are teachers who can reproducibly create success levels given the control of the situation that they do have.

How is it any different than the rest of the working world where you can control some things and you can't control others yet your job is to do the best you can with what you can control?

Re:Gates Foundation study: We’ve figured out what makes a go... by sethammons on Tuesday January 15, 2013 @09:09AM (#5060122)
Here is some experience that I have had. In an inner city high school (math class), in each mid-thirty student sized class, there were about four students who made it their point to disrupt the classroom. Unless actual violence occurred, they were not to be kicked out. So the teacher could spend a large portion of the period trying to reign in a couple of students at the expense of the whole class. Add to that that the majority of the class had difficulty with, not just multiplication or division, but SUBTRACTION.

This was an Algebra class, and the students had to be graded on their Algebra skills and judged on their Algebra proficiency tests. No homework would be completed, and no recourse could be given for lack of homework. 50% of these 9th grade students will not make it graduation. 3% will make it to a four year institution. Less will graduate from there.

How is this different than working with professional engineers? Ones who could be fired or in some other way worked with? How is this different than working code where a solution exists? How is this different than working with other people who are looking for a solution as well?

A better comparison would be to how you judge a prison guard in relation to recidivism rate.

Re:Gates Foundation study: We’ve figured out what makes a go... by gnosis on Tuesday January 15, 2013 @08:34AM (#5059976)
That's a very legitimate question. How can teachers do the best with the resources they're given and the the children they're working with, no matter how threadbare the resources are, and no matter how traumatized and disadvantaged their students are?

Whether standardized tests have a role in answering that question or in evaluating teacher performance is hotly debated right now.

But the purpose of my original post was to draw attention to a different question: How can society as a whole ensure that every child gets the best education possible?

In schools that have no problem attracting resources, great teachers, and children with mostly fortunate backgrounds, perhaps this second question can be answered by asking the first: how can we improve our teachers?

But in schools that lack resources, whose students live in abuse, poverty, and despair, what even an exceptional teacher can do will be radically limited, and society would probably be better off focusing on how to eradicate poverty -- the real cause behind the failure of too much education in this country.

Unfortunately, seriously tackling the issue of poverty is much harder (and even contrary to some dominant American ideologies) than simply demanding more standardized tests be given and blaming teachers and their unions.

Re:Gates Foundation study: We’ve figured out what makes a go... by ameister14 on Tuesday January 15, 2013 @11:03AM (#5060775)
I grew up in two very different places; Bethesda, MD and Winthrop, ME. The former is a fairly wealthy suburb of DC. The latter is an extremely rural mill-town in Maine.

I know that the funding the schools get is blamed for a lot of their problems, and I understand where people who talk about how hard it is to teach kids with behavioral issues and histories of abuse are coming from.

I sympathize, but I also think that's a cop-out. I had bad teachers in both places. In Winthrop, I had horrible teachers. They took away advanced classes because an outside contractor thought it created elitist attitudes and putting smart kids in the regular classes would boost overall performance.

I had science teachers that just had us play with legos all day and gave A's to all the basketball players. I had math teachers that would lose assignments and blame the students. These were not well-meaning teachers that just had it hard trying to teach these poor kids. These were people that shouldn't have been teaching at all, but could not be replaced.

My parents actually went up to the school a few times to try and talk to the administration and teachers about what was going on. A lot of people did. They got push-back and were asked not to meddle.

There were 2 great teachers there and that's why I didn't completely screw up my life at that point. I've spoken to a lot of people with similar experiences; 1 great teacher that pushed them to be successful. That's why it's so maddening to me when people say that it's not the teacher's fault, that they can't do anything about it. I know that's not entirely what your intent with your post was, but focusing on external environmental issues and bemoaning the poverty of the student body can come across that way.

While poverty is a major issue, and teaching is hard, I don't think you can solve the problems by just changing the student's home environment. You have to change the teachers as well.

Lots of jobs are hard. Doctors have to deal with unruly patients who refuse to change their diet or exercise. Don't they get blamed when their patients don't improve?

Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @08:57AM (#5060077)
How can society as a whole ensure that every child gets the best education possible?

Step one, define "best education possible". Step two, learn to measure whether or not a child is getting one (or the closest you can come to it). Step three, maximize some aggregate or regionalized version of your measurements through restructuring of school systems, rewards for good schools and teachers, etc.

The study in this article is just gets us to step two. It looks like you're wanting to discuss step three. That's a different can of worms.

Re:Gates Foundation study: We’ve figured out what makes a go... by randomdata on Tuesday January 15, 2013 @09:32AM (#5060228)
It is not even clear if the article gets to step one. Some of the teachers who I feel had the greatest impact on my education taught classes that I did not necessarily score well in. If I am a statistical norm, those teachers would be consider poor teachers according to the metrics, contrary to reality.
Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @11:04AM (#5060788)
This is where I have an issue with this discussion. You're throwing up anecdotal data in the face of an actual study. Why is that okay in a community like this that understands the Scientific Method and should have a basic understanding of statistics.
Re:Gates Foundation study: We’ve figured out what makes a go... by randomdata on Tuesday January 15, 2013 @11:10AM (#5060845)
The only point I was trying to make is that test scores do not necessarily define the success of a teacher. I suggest, to be able to apply scientific method and get meaningful results will require far more data than is seemingly being collected.
Re:Gates Foundation study: We’ve figured out what makes a go... by yummyfajitas on Tuesday January 15, 2013 @12:34PM (#5061477)
What data do you feel is needed, but not there?
Re:Gates Foundation study: We’ve figured out what makes a go... by sopooneo on Tuesday January 15, 2013 @10:46AM (#5060664)
What about prenatal counselling and early childhood nutrition programs and parenting classes? What if those things in underprivileged areas has more affect on educational outcomes (however defined) than teacher selection?
Re:Gates Foundation study: We’ve figured out what makes a go... by Mvandenbergh on Tuesday January 15, 2013 @08:49AM (#5060043)
You may not control the home life of your engineers, but you presumably have at least some control over who you hire and fire. Even if you don't have the authority to fire someone directly you can still give your subordinates poor evaluations.

Imagine being a situation where not only did you not have any control over which engineers worked on your team - or even whether they were engineers at all, or even basically literate. Now imagine that your whole industry pretty much worked liked that and that changing from one company to another (which most likely worked the same way) always meant moving cities.

Incidentally, what they did in this study is to measure the value-addition of each teacher, not their raw test scores. Presumably you're not evaluated based on things you have absolutely no control over, as you said - you get judged based on the slice of the pie that you do control.

Re:Gates Foundation study: We’ve figured out what makes a go... by sopooneo on Tuesday January 15, 2013 @10:44AM (#5060643)
You make a valid point, and from the perspective of a teacher, or someone in charge of teachers, it is necessary to take your view. However, from public policy perspective, focusing strictly on teachers may be missing the mark.

As an aside, it occurs to me that those teachers who are most effective in underprivileged schools may be totally different than those in wealthier schools.

Re:Gates Foundation study: We’ve figured out what makes a go... by mac1175 on Tuesday January 15, 2013 @08:37AM (#5059984)
I think relativism does play a role on outcomes regardless of the parallels you are drawing here. However, you do make a point on a person's competence based on how well they can handle a situation but I don't think you can group one's role as a teacher being equal as one's role as a lead engineer.
Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @08:50AM (#5060055)
I don't think you can group one's role as a teacher being equal as one's role as a lead engineer.

Why not? Government run education is pathetic. Incentives are all out of whack, there's no competition between teachers or schools that can affect the status quo.

Teachers could use a huge dose of whatever it is that the more competitive business world has to deal with.

Re:Gates Foundation study: We’ve figured out what makes a go... by sethammons on Tuesday January 15, 2013 @10:12AM (#5060445)
Schools are the entity least run like a business out of anything else I can think of -- this is at the administrative level. When it comes to teacher competition, it is a different game than Company A winning a competitive contract over Company B. We want both companies to win here (read: both teachers -- or schools). Another problem with this idea is that you can fire obstinate clients. You can't do that with students.

Teacher competition, I think, would reduce collaboration. Why give your competitor your secrets to success?

Incentive pay? The problem under this idea is that new teachers are often given the most difficult and unruly of students while more experienced teachers get honors classes. I find this odd because the teachers will the best "tools" for dealing with difficult problems are moved away from those problems.

Then again, the problem is that with any idea for reform, there is a list of reasons why it should not or would not work.

I'm a fan of letting students who are not interested in the academics of school work towards trade school and let those who are academically inclined to work towards university. However, a retired college physics professor friend of mine does not like this solution because he would have been tracked towards trade school and never discovered his love for physics.

Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @11:31AM (#5061024)
I recommend that you watch "Waiting for Superman". It focuses on the charter school initiatives across the country and shows that maybe we should be running schools much more like businesses. When you see how poor the options are for many of these inner city kids outside of the limited charter school options - it's heartbreaking.

Just like you'll see recommended on HN, if you're going to fail, fail early and get on with something that has a chance of working. Our government funded education system is a long painful failure that established forces prevent from being scrapped and reinvented.

Re:Gates Foundation study: We’ve figured out what makes a go... by nnnnnnnninnnnnn on Tuesday January 15, 2013 @09:00AM (#5060086)
You do however get to control who your engineers are. It's rather difficult for a teacher to "fire" a student.
Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @09:17AM (#5060165)
I don't get to control the projects sent my way. I'm not allowed to "fire" customers with difficult expectations.

Hell, I've only ever fired one engineer in a 20+ year career, and that was because he was the equivalent of a violent student whom you would expel and send to juvi.

Why is it so hard to deal with the information as presented in the study. Fine, question the details or methods of the study. Offer counter evidence. The study presented evidence that good teachers can have a noticeable and measurable level of control on the output of their students. Why is dealing with evidence not the central part of this discussion?

Re:Gates Foundation study: We’ve figured out what makes a go... by nnnnnnnninnnnnn on Tuesday January 15, 2013 @03:13PM (#5062669)
I'm not sure why you're talking about "firing" customers. That might be the equivalent of teachers firing student's parents? Anyways, what I was trying to get at is that people working at a company choose to work there, MOST of the time they are doing something they are good at. Compare this to students, teachers do not get to choose their students from a set of applicants. Also oftentimes students do not see the benefit of being in school. I am not opposed to the study, I was only addressing the point you made about comparing a school to your company. I do not think it is a very good comparison.
Re:Gates Foundation study: We’ve figured out what makes a go... by elemenohpee on Tuesday January 15, 2013 @08:36AM (#5059980)
> How is it any different than the rest of the working world where you can control some things and you can't control others yet your job is to do the best you can with what you can control?

So the argument is that since everyone sucks at measuring things that any arguments about how a particular system of measurement is ineffective should be discarded?

Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @08:41AM (#5060009)
So the argument is that since everyone sucks at measuring things

You read something into my argument that I didn't put there, so I'm going to disregard it as a straw man.

Re:Gates Foundation study: We’ve figured out what makes a go... by elemenohpee on Tuesday January 15, 2013 @09:36AM (#5060256)
Sorry, I wasn't trying to create a straw man, just trying to tease out a hidden premise, although I suppose I could have been less of a dick about it.

I think we can all agree that judging people based on things that they have no control over is not an effective way to evaluate them. This happens in education, as the parent comment outlined. This happens in engineering, as you outlined. It does not follow that teachers should be evaluated in this way, or that a discussion about the problems with this method should not take place.

Re:Gates Foundation study: We’ve figured out what makes a go... by crusso on Tuesday January 15, 2013 @11:12AM (#5060859)
I really appreciate the way you're saying it, but I still think you're reading things into my words ("everyone sucks at measuring things" was not even a hidden premise). Worse, you're not acknowledging the evidence mentioned in the study.

The study attempted to control for things the teacher's couldn't control. They're actually being differentially judged on the parts of education that they can control.

These lines from the article fly in the face of your entire argument: "They also ranked the teachers using a statistical model known as value-added modeling, which calculates how much an educator has helped students learn based on their academic performance over time".

You would need to address them directly in order to mount a credible counter-argument.

Re:Gates Foundation study: We’ve figured out what makes a go... by bjhoops1 on Tuesday January 15, 2013 @11:23AM (#5060957)
So true! All of those factors exert an enormous effect on the outcome of a student's education. Unfortunately (except for the school resources issue) they are all completely out of the teacher/school/district's ability to control.

Whenever teacher/school issues come up, it is important to remember that far beyond anything a school or teacher can do, the single-most important factor in a child's education (or their life in general!) is their PARENTS. If a kid has parents who value education, discipline their kids and make time for learning at home, that kid can do just fine no matter what kind of conditions they experience at school. Conversely, it takes a Stand and Deliver-style superteacher to be able to coax success out of a kid growing up in a home where education is not valued and productive personal habits are not modeled.

The biggest problem with education? There are far, far too many parents out there who have absolutely no business raising children at all. We require tests for people to operate a jet ski, but when it comes to absolute power and responsibility for a human child, anybody can do it! That's your right! Don't worry about saddling the rest of society with your child who doesn't stand a snowball's chance in hell of ending up well-adjusted, educated or successful. It's YOUR kid.

I understand that people who are struggling with extreme poverty are often too caught up with bare survival to find the time to focus on their children's educational needs. That is really awful and sad. It is especially sad for their children.

The fact is, as long as society is full of self-centered, thoughtless parents who either fail to understand the basic components of child-rearing or are too busy surviving to care, we will be plagued with students who are going to struggle no matter how great of an educational system they are placed in.

That being said, perhaps the only way to raise a generation of education-valuing, quality parents is to do what we can to create them. So maybe it is best after all to focus on what CAN be done - effective teaching methods for today's teachers. Hopefully a much-improved school system can help raise the prospects of children whose parents are doing nothing to give them a hand up. And then they in turn can become the kinds of nurturing, education-valuing parents that their own children deserve.

Re:Gates Foundation study: We’ve figured out what makes a go... by Symmetry on Tuesday January 15, 2013 @09:08AM (#5060119)
So, if a teacher has as little effect on a child's performance as you seem to be implying should we then reduce teacher pay, accept the lower quality applicants we would get since it doesn't matter, and spend the extra money on anti-poverty measures?
Re:Gates Foundation study: We’ve figured out what makes a go... by Mvandenbergh on Tuesday January 15, 2013 @08:42AM (#5060017)
That's why they do value-added testing rather than just evaluating teachers based on the score of their pupils. Obviously there are confounding factors, but if a teacher can make a statistically significant difference to the the test scores - as measured by before and after testing then that is valuable to know.
Re:Gates Foundation study: We’ve figured out what makes a go... by yummyfajitas on Tuesday January 15, 2013 @11:43AM (#5061109)
Irrelevant. The study uses Value Added Modeling, which accounts for these factors.

Unless the student's parents started abusing them in the year the teacher is being evaluated, it is already accounted for. VAM measures deltas, not absolute levels.