To address your specific fallacy, the output of coding is heterogeneous while the output of teaching is homogeneous. If I code today, it's a realtime optimization system. Tomorrow it might be a search product. When I taught, the output was always the same: students who understand calculus.
It appears you are claiming that when you taught the output was the same each day. Each day you taught your students learned calculus and understood it. Each day you may have taught an aspect of calculus but the topics varied from day to day. Furthermore, assuming undergrad level, it can't be believed that each of your students understood each topic you taught.
The dichotomy you've laid out between programming and teaching is not apt.
Not every student understood every topic. So what?
Your statements here strengthen the parody. Merge sort is the same for everyone, right? So let's just go by lines of code. The outcome is the same.
Two different people don't teach the same way even if the curriclumn is the same.
So what? The goal is the same. It is meaningful to measure whether my students know more or less calculus than yours.
If the goal of programming were to re-implement merge sort over and over then it would be an effective metric to count the number of correct merge sort implementations.
The inability to compare a realtime monitoring system to a web scraper is what makes programming harder to measure.
But in many cases one can measure programmers by output. For example, at Styloot, one task we have is building web scrapers. They all have a pretty straightforward (and identical) goal. An effective metric for programmer performance on this task would be to measure the # of scrapers written or (better) the # of items correctly scraped.
See also quant traders - the goal is homogeneous (increase profit, adjusted for risk), and your code is measured by how well it achieves that goal.
Yes.
That was, to some extent, my point :-)
That and the fact that many HN folk will have encountered management doing dumb things like equating velocity or cycle time or lines of code with productivity. Which may explain their aversion to simplistic metrics like this.
To address your specific fallacy, the output of coding is heterogeneous while the output of teaching is homogeneous. If I code today, it's a realtime optimization system. Tomorrow it might be a search product. When I taught, the output was always the same: students who understand calculus.
Really? I can easily see it from the opposite point of view. When I code I'm just delivering running-tested-features. When I teach (which I have done, and still do) every student is different - they often start from radically different positions of attitude, aptitude and existing knowledge.
And measuring 'teaching quality' is not a simple as counting ad click-throughs. Education is at least as much about helping people learn about their role in the world, as it is about learning facts, concepts, and tools. Just measuring the increase of students' scores on standardized tests misses a lot of the impact teachers have on their students' minds.
Nobody in his right mind would judge a developer solely on the amount of features he has implemented during the previous year, but also on how robust and maintainable the code is. I you want to take these factors into account, you have to actually read the code, understand it, and ideally talk to the developer about it. Unless you do this, you can not judge the quality of the code.
The same holds true for evaluating teachers, imho. Administrators need to talk to students, parents and teachers and form a comprehensive image of a teacher's ability. I really think it is that simple. Certainly not perfect. But not less perfect than standardized testing.
As a German, maybe I am misunderstanding some properties of the US educational system.
The whole reason that test results are being used as opposed to manual assesment, is that test results have proven to be a better predictor of long term outcomes. Test results aren't perfect but they're better than what was previously used.
i'm not sure what long term outcomes you're referring to and how they were measured, but if they're education related the measurement was probably more test results. Yes, test results are a good predictor of future test results.
Addendum:
My understanding is, that in the United States anyone can relatively easy train to be a school teacher. In Germany they are tenured civil servants with at least 3-4 years of study.
Could you explain what this means more precisely? Specifically, how can I differentiate a student who knows "about their role in the world" from one who doesn't?
https://iandravid.wordpress.com/2008/01/19/carl-sagan-dragon...
How can I know a calculus test exists? Very easily. I look at it, feel it, etc. How can I know calculus ability exists? Again, very easily - it predicts outcomes on a set of correlated exams, the existence of which I verify with sight, touch, etc.
You seem to want to argue that education only produces vague, immaterial and unmeasurable outcomes. Lets take that as a given - in that case, why not just eliminate education spending and save $900B/year?
You seem to confuse physical existence and idea. Presumably a physical object can be painted but ideas can't. Lot's of things exist that can't be verified by sight, touch, etc. In my opinion being a good teacher is not something that can be reasonably measured. I'm open to the possibility that I'm wrong but have seen no evidence that I am.
The Life of Samuel Johnson (James Boswell)
You're actually better off with no information than with bad information.
A better analogy would be a medicine that typically leaves patients worse off than they were before treatment.
I'm not saying they should give up the search for something that works, but they absolutely should not cause harm just for the sake of doing something.
Define success.
If one gets the best score but has no social skills, no friends, no fun and no creativity then is that success.
This (only considering a test score) is like doing A/B testing but only looking at impressions and not at conversions, or only looking at conversion rates and not at conversion value. In web terms you can succeed by reducing both your impressions and conversion rates (by taking more money of less people and only attracting motivated customers).
Sorry that's more destructive than constructive WRT what the right course of action is.
Are there [large scale] education systems that consider happiness of pupils, reduction in bullying, positive social interaction and such to be metrics to assess and improve?
Nobody is arguing against testing. They're arguing about doing tests where you know the results will be deeply flawed.
He was pretty firm that this method would be better—he'd spent years thinking about it—but we both agreed that it required a level of intervention by the administrator that although it could reasonably be expected was unlikely. Using just the test data is the lazy way, which means it's the method most will use.
Still, I believe _some_ standardized testing is important. ... but there are two types of tests: norm testing and standards testing, and both types have their uses.
This is assuming that the net effect of the tests is positive, thus we should keep them until we find something better. But a lot of comments are pointing at the harm caused by standardized testing. For people who think the net effect is negative, the rational thing to do is get rid of them until we find something better.
If your rank the teachers in a strict order, you have to make someone the worst and someone else the best teacher. But is the administration going to check how much worse the worst teacher really is? I doubt it.
There is no simple fix. There are bad teachers (and I'm leaving the term undefined - it's a bit like porn - undefinable, but recognisable) who get good test results and glowing evaluations, and there are superb teachers who get mediocre test results and undistinguished evaluations.
It's easy from the outside or from a limited perspective to suggest "obvious" methods of assessment or "obvious" actions to improve the situation, but in the end, no one has really defined what they mean by "good teaching," so proposing assessments of something undefined will just result in more proxies to be distorted.
Why should test scores improve year over year? If everyone is getting a 2/6 then yes, but students in the same grade are not going to get smarter every year. There is the major flaw in using student tests to measure teachers IMO. You are going to get a bell curve around 4/6 from the test results for majority of the teachers. When you don't, it is really hard to tell whether the reason is the teaching, the curriculum, the students or the test and its grading.
Give me a better metric for success that you can measure over the course of a year.