News for hackers. Stuff that matters.
Re:A letter to the TEDx community on TEDx and bad science by tokenadult on Friday December 07, 2012 @02:23PM (#4888725)
Other comments in this thread helpfully explain the context of these recommendations. The TEDx brand name is now used to label local events set up by busy volunteers who need criteria for evaluating speaking proposals. The majority of the criteria are sensible and helpful, but I see one criterion that is overly broad, as another subthread first noted.

"Holds a nonstandard degree. For instance, if the physics-related speaker has a degree in engineering, not physics; if the medical researcher does not have an M.D. or Ph.D.; if the affiliated university does not have a solid reputation. This is not snobbery; if a scientist truly wishes to make an advance in their chosen field, they’ll make an effort to engage with other scholars."

Well, unless what is meant here by "make an effort to engage with other scholars" is publish in the same peer-reviewed journals as the scholars with the expected credentials, this criterion sweeps up too many path-breaking scientists. I will give one famous example. James R. Flynn is a researcher on human intelligence who has had several peer-reviewed publications in Psychological Bulletin, the premier research journal on psychology in the United States.

http://scholar.google.com/scholar?q=author%3AJames+author%3A...

But Flynn's Ph.D. degree is in sociology, not in psychology. He looks at the discipline of psychology as an outsider, and it is precisely that outsider's view that helped him make a discovery missed by dozens of psychologists. He discovered that IQ scores have been rising in national populations all over the world during the last century, and that trend of rising raw scores on IQ tests is now called the "Flynn effect" in his honor.

Here is what the late psychologist Arthur Jensen said about Flynn back in the 1980s: "Now and then I am asked . . . who, in my opinion, are the most respectable critics of my position on the race-IQ issue? The name James R. Flynn is by far the first that comes to mind." Modgil, Sohan & Modgil, Celia (Eds.) (1987) Arthur Jensen: Concensus and Controversy New York: Falmer. Here's what Charles Murray (all right, not a psychologist nor a geneticist) says in his back cover blurb for Flynn's book What Is Intelligence?:

http://www.amazon.com/What-Intelligence-Beyond-Flynn-Effect/...

"This book is a gold mine of pointers to interesting work, much of which was new to me. All of us who wrestle with the extraordinarily difficult questions about intelligence that Flynn discusses are in his debt." As psychologist N. J. Mackintosh (1998, p. 104) writes about the data Flynn found: "the data are surprising, demolish some long-cherished beliefs, and raise a number of other interesting issues along the way." Flynn has earned the respect and praise of any honest researcher who takes time to read the primary source literature. Robert Sternberg, Ian Deary, Stephen Pinker, Stephen Ceci, Sir Michael Rutter, and plenty of other eminent psychologists recommend Flynn's research. So, yes, sometimes "an effort to engage with other scholars" will happen after a scholar has already earned his last academic degree, and a scholar that has an important concept named after himself by people who have the standard degree will never have the standard degree for the field in which he made his mark.

EDIT PROMPTED BY SECOND REPLY: I'll attempt to be clear here. If the TEDx criteria included "has never been published in any major journal related to their chosen field" rather than "holds a nonstandard degree" not related to their chosen field (to speak about), I might have fully agreed with the criteria from the get-go. But degrees are both an overinclusive criterion and an underinclusive criterion. In other words, using degrees as a criterion for vetting speakers lacks both sensitivity and specificity.

http://en.wikipedia.org/wiki/Sensitivity_and_specificity

Instead, look at publications as the relevant criterion. A person who has peer-reviewed publications in a good-quality medical journal is competent to speak on the issues discussed in that person's publications, with or without a medical degree, while a person with the M.D. degree who has never published in anything but "alternative medicine" journals is not well qualified to speak about medicine. Publications matter more than degrees, as the example of James R. Flynn I gave in the original edit of this post shows.

On the broader "demarcation problem" of distinguishing science from pseudoscience, a really valuable recently published book is The Pseudoscience Wars: Immanuel Velikovsky and the Birth of the Modern Fringe by Michael D. Gordin,

http://www.amazon.com/dp/0226304426

which I found to be quite an interesting read, full of historical and ideological connections I had not heard about before. The author, a historian of science based at Princeton University, makes clear that demarcating between "science" and "pseudoscience" is not at all easy in any era. Reviewers generally like this book, as I did.

http://www.timeshighereducation.co.uk/story.asp?storycode=42...

http://www.tnr.com/book/review/pseudoscience-wars-michael-go...

http://online.wsj.com/article/SB1000087239639044470900457765...

http://www.lrb.co.uk/v34/n21/steven-shapin/catastrophism

Re:A letter to the TEDx community on TEDx and bad science by kevinpet on Friday December 07, 2012 @05:05PM (#4889475)
Your counter example is poor. Flynn holds a degree in a related (but not closely related) field. He holds a PhD from a real university. He has published in the leading journals for his area of research.

The only possible way he triggers any of these red flags is a degree in sociology rather than psychology. These are red flags calling for more scrutiny, not strict conditions. And indeed, it seems like Flynn does deserve more scrutiny. He's clearly a legitimate scientist doing important work, but this is despite the red flag of being someone from a different field offering up theories that go against previously established science. He shares several of the quickly observable features of a crank.

How do we know he isn't a crank? Because he's published in the leading journals and other scientists who meet the "not a crank" test have said that his work is worthwhile.

In short, this is not a false alarm by the "red flags". This is a correct alarm.

Re:A letter to the TEDx community on TEDx and bad science by wisty on Friday December 07, 2012 @07:35PM (#4890031)
The original example was poor. Engineering and Physics are closely related fields.
Re:A letter to the TEDx community on TEDx and bad science by sopooneo on Saturday December 08, 2012 @11:36AM (#4891933)
A lot of physics quackery comes from engineers.* Their knowledge of advance physics is generally nowhere near that of a physics PhD, but their title lends them credibility to many people.

* I have not found the reverse to be true.

Re:A letter to the TEDx community on TEDx and bad science by gus_massa on Saturday December 08, 2012 @02:32PM (#4892457)
I don't know about physics, but a few years ago here in Argentina there was a epidemy of "engineers that solved the Goldbach conjecture". A few (¿maybe 5?) of my math Ph.d. students friends had each one his/her own engineer with a different unrelated proof.

The histories where all different, but generally it was a long (100 pages) proof that was involved and not very clear. So the math Ph.d. student and the engineer meet weekly for one year to try to understand the proof. It was very painful because they have to understand which part was only unclear or has only small gaps, and which parts had errors that were impossible to fix. And then they had to explain that to the engineer, that were happy to had solved the conjecture.

All of this is in a scientific field that there isn't too much money, press coverage or social prestige involved (not like a "cure for cancer"). So I think that in more applicable fields the problem is worse.

Re:A letter to the TEDx community on TEDx and bad science by nollidge on Monday December 10, 2012 @09:15AM (#4899046)
And some biology crankery comes from physicists: http://freethoughtblogs.com/pharyngula/2012/11/20/aaargh-phy...
Re:A letter to the TEDx community on TEDx and bad science by pwang on Saturday December 08, 2012 @04:16PM (#4892719)
A lot of physics quackery also comes from physicists. :-P
Re:A letter to the TEDx community on TEDx and bad science by jlgreco on Friday December 07, 2012 @02:52PM (#4888910)
The issue that TEDx has been having is not that talks have been given that are "maybe pseudoscience-ish". Not stuff in which an unclear demarcation line is an issue. Rather the issue is that talks have been given that are plainly bullshit to anybody with a few braincells still firing. We are talking crystal and pyramid levels of bullshit here. Barely above the level of mad ravings on a street corner.

The issue with botched skepticism among TEDx organizers appears to be so severe that the guidelines to skepticism given, no matter how crude, are entirely justified.

Re:A letter to the TEDx community on TEDx and bad science by zevyoura on Friday December 07, 2012 @08:23PM (#4890198)
Could you give an example of one that's particularly egregious? I've seen a couple that seemed questionable (based on my gut feeling, not any specific knowledge of the subject), but none that seemed as absurd as the crystal folks.
Re:A letter to the TEDx community on TEDx and bad science by pharrington on Friday December 07, 2012 @09:15PM (#4890328)
http://www.youtube.com/watch?v=Yzfgq1zv8jg

Randy Powell on Vortex Math - "The most advanced mathematics ever known to mankind."

yeah.

Re:A letter to the TEDx community on TEDx and bad science by entropy_ on Saturday December 08, 2012 @07:08AM (#4891454)
I am speechless... What appals me the most though is the applause and cheers at the end, even one person -- that I could see -- standing up while clapping. As far as I could tell this talk was generated by a bot(something like this: http://pdos.csail.mit.edu/scigen/) or something and nobody seemed to notice anything wrong. Just a stream of jargon strung together in what seems like english.
Re:A letter to the TEDx community on TEDx and bad science by zevyoura on Friday December 07, 2012 @10:37PM (#4890521)
Yikes, this is just awful. I keep expecting James Randi to enter stage right and explain this was all some kind of test for the audience.
Re:A letter to the TEDx community on TEDx and bad science by munger on Saturday December 08, 2012 @01:19AM (#4890894)
Another gem from this video, not that there is a shortage of them - at 3:55 - "It makes us into a vortex machine, sucks things in at the top and shoots them out of the bottom"
Re:A letter to the TEDx community on TEDx and bad science by gus_massa on Saturday December 08, 2012 @03:17PM (#4892570)
How many points for this in the Crackpot index?http://math.ucr.edu/home/baez/crackpot.html
Re:A letter to the TEDx community on TEDx and bad science by jmilloy on Friday December 07, 2012 @05:22PM (#4889548)
It's very simple. Using this document, you might interpret Flynn's psych degree as a "common warning sign" and so, as the document suggests, "be alert". A cursory search of Flynn's work, as you show, would alleviate those concerns immediately. The document doesn't claim to be a blacklist and doesn't read that way.

Furthermore, "Engage with other scholars" certainly does includes publishing in peer-reviewed journals; why wouldn't it? And beyond that, some of those publications are co-authored.

Re:A letter to the TEDx community on TEDx and bad science by Symmetry on Friday December 07, 2012 @04:13PM (#4889284)
I'm curious as to why you think publishing in peer-reviewd journals wouldn't count as "make an effort to engage with other scholars". Honestly, I'd take that, or being a speaker at a mainstream conference, or getting someone with a relevant PhD to say something nice about you as clearly passing that hurdle.
Re:A letter to the TEDx community on TEDx and bad science by shawn-butler on Friday December 07, 2012 @04:34PM (#4889363)
TedX are equivalent to local Grammy awards. They are just an excuse for people to get together and give themselves exposure in local context as experts or best practitioners. It's just promotional.

Also, Shapin is not a very respected historian. Social history of truth is more fiction promoting an agenda than history. I wouldn't cite him if I were you or only with caution.

Re:A letter to the TEDx community on TEDx and bad science by csours on Friday December 07, 2012 @05:00PM (#4889455)
I think these should be taken as permissive guidelines rather than exclusive guidelines, that is if several of them are true you should beware rather than excluding a speaker based on a single rule.
Re:A letter to the TEDx community on TEDx and bad science by pseut on Saturday December 08, 2012 @12:02AM (#4890715)
I agree with your point in general, but given this statement from the post:

> Start with some basic web research. You should be able to understand at least the big issues in every field you present onstage. Wikipedia is your first stop to gain a basic background.

(emphasis mine) you might be expecting too much of the TEDx organizers. If they're referring these people to Wikipedia to evaluate the speakers credentials, probably reading off the degree name is closer to their capabilities than evaluating the scope and prominence of their research.