Thanks for the citation, but since I can't look up the book right now, perhaps you can answer a question. Is that really measuring the "average?" Or the average score of 13-year-old white students who are taking the test? That's a very biased sample; for instance, I took the test when I was 12 only because I seemed likely to qualify for the Center for Talented Youth.
Unfortunately I don't have my copy on me so I can't look up the footnote in the back. IIRC it was the SAT, but I'm not entirely positive.
If you want to see something really telling about standardized testing though, check out this Greg Palast article on how the NCLB discriminates against minorities:
http://www.phillyblog.com/philly/nation/13968-no-child-left-...
Insulting question: I wonder if the authors made a certain specific error, when making said error implies the person is either ignorant, stupid, or intellectually dishonest.
I'm not not going to defend the statistic since I haven't seen the methodology. That said, I do think it's insulting to the authors to ask if they've made a very basic and specific error without first reading the methodology.
In any event, I'm sure you could email any of the authors and ask where the statistic came from if you are interested.
One of the most noticeable differences between A and AB is that in AB, you go into algorithms and big O notation in much more depth, and you do some work with implementations of binary trees and such. When they cut out AB, they are leaving what is essentially an AP Introduction to Java.
It's sad that this passes off as computer science. I'm taking the test so I can hopefully skip the course and move on to fun stuff that has APCS as a prerequisite. Fun stuff like AI. AI, the class where Python and Ruby are the default languages, and you get to use other things if you want, like Lisp.
(I found this out when I still didn't know much about Lisp, saw someone using it, and laughed at the stupid, old language with all the parentheses. The guy tried to explain that Lisp is a good language, but I wasn't convinced. Later I independently stumbled on some of PG's essays, and I was convinced.)
http://www.livescience.com/health/070522_finger_sats.html
Although I myself did well on the SAT's, I too am hesitant to support the use of correlations like these in determining what students, or anyone deserves.
With regard to SATs and academic performance, the first google result:
"Findings indicated a very low correlation between SAT math scores and overall college math grades of six graduating classes at one university"
http://eric.ed.gov/ERICWebPortal/custom/portlets/recordDetai...
You may enjoy this anecdote, in which someone even more self-righteous about such things makes a fool of herself:
http://isteve.blogspot.com/2007/05/finger-length-and-sat-sco...
There is one study that shows there is a correlation between SAT score and college GPA, but only for students whose HS GPA is above a 4.0. In general though the test doesn't really have any validity.
Here is a link to the studies the College Board is promoting:
http://professionals.collegeboard.com/data-reports-research/...
They mention that a 100 point increase on the SAT corresponds to a 0.1 boost on college GPA. Assume a linear relation: this means that a 1500 SAT student might expect a 3.0 GPA, while a 1000 SAT student might expect a 2.5 GPA. That's actually a great predictor.
Then they mention other studies of SAT scores within a fixed college. This is deceptive. A typical college has students from a narrow SAT range (say 1200-1400). By the above numbers, one expects that SAT predicts only 0.1 GPA above/below the mean (within the college). However, it also predicts that if the school were to ignore SAT and admit a cohort with SAT's of 800, then those students would underperform by half a letter grade.
If you really wanted to figure out the value of the SAT you would have to use a much more robust measure of cognitive development than freshman GPA. However, it doesn't look like anyone is going to undertake such a massive project anytime soon. Incidentally, Alfie Kohn has some really good stuff to say about grades in both Punished By Rewards and also in What Does It Mean To Be Well Educated?
Also, I should have mentioned above that there are some meta-studies that find that degree of validity depends on the person's race, and that if you take the person's race into account the test can be useful. I have multiple objections to this though, both practical and theoretical.
Actually, it's more likely that political correctness creates a chasm between what people say and what they really think.
Did you know that weight doesn't correlate very well with linebacker performance in the NFL? It could be that a 350-pounder is just as effective as a 150-pounder, and there's some pro-fat discrimination -- or it could be that you're talking about correlation within a school, which chooses people on the basis of multiple criteria including SATs, such that their students are about equal academically.
Consider: a school could look at two people, one of whom gets a perfect math SAT and a 500 verbal, and another of whom gets 600 on each and writes a killer admissions essay. The former student gets a 3.5 focusing on math and CS. The latter gets a 3.5 taking English and Philosophy. This is the kind of evidence schools find; that people play to their strengths, so as long as they're of similar average talent, they'll have similar success, even if an individual measure of that talent doesn't correlate with their relative success among people who by the average of many measures, are very similar.
This has been a well-known problem with the studies you cite for over a decade.
Note that the book is written about, and the comment refers to, <em>schools in large cities</em>.
And yet somehow I doubt the College Board is going to drop the SAT anytime soon. Dropping AP classes "for racial diversity reasons" is like making Rosa Parks the TV spokeswoman in the front to mask the secret eugenics program going on in the back.
[1] It Takes a City: Getting Serious About Urban School Reform [2] C.f. the academic research into the validity of the SAT on the College Board website. (There have been plenty of popular press articles written on this too.)