News for hackers. Stuff that matters.
Re:One hiring filter that works by tokenadult on Friday April 06, 2012 @10:59AM (#3807363)
The HUGE peer-reviewed professional literature on industrial and organizational psychology has many articles devoted to business hiring practices. There are many kinds of hiring screens, such as resume reviews for job experience, telephone interviews, in-person interviews, checks for academic credentials, and so on. There is much published study research on how job applicants perform after they are hired in a wide variety of occupations.

The overall summary of the industrial psychology research in reliable secondary sources is that two kinds of job screening procedures work reasonably well (but still below the .50 level, standing alone). One is a work-sample test, where the applicant does an actual task or group of tasks like what the applicant will do on the job if hired. Another is a general cognitive ability test (an IQ-like test, such as the Wonderlic personnel screening test). Each of these kinds of tests has about the same validity in screening applicants for jobs. Neither is perfect (both operate at about .4x level in validation studies), but both are better than anything else that has been tested in rigorous research, across a wide variety of occupations. So if you are hiring for your company, it's a good idea to think about how to build a work-sample test into all of your hiring processes.

For legal reasons in the United States (the same consideration does not apply in other countries), it is difficult to give job applicants a straight-up IQ test (as was commonplace in my parents' generation) as a routine part of a hiring process. The Griggs v. Duke Power, 401 U.S. 424 (1971) case in the United States Supreme Court

http://scholar.google.com/scholar_case?case=8655598674229196...

held that cognitive ability tests used in hiring that could have a "disparate impact" on applicants of some protected classes must "bear a demonstrable relationship to successful performance of the jobs for which it was used." In other words, a company that wants to use a test like the Wonderlic, or like the SAT, or like the current WAIS or Stanford-Binet IQ tests, in a hiring process had best conduct a specific validation study of the test related to performance on the job in question. Some companies do the validation study, and use IQ-like tests in hiring. Other companies use IQ-like tests in hiring and hope that no one sues (which is not what I would advise any company). Companies outside the United States are regulated by different laws.

Re:One hiring filter that works by scott_s on Friday April 06, 2012 @11:13AM (#3807414)
The author's point, however, is wider than what you discussed. Filtering is one thing, which it sounds like the literature you mentioned covers. But filtering makes the assumption that the candidates have already decided to apply. The author of this piece found that he got significantly more applications when he added a test. So it's not just filtering, but also advertising.
Re:One hiring filter that works by rdl on Friday April 06, 2012 @12:31PM (#3807818)
How specific to the job does the validation of IQ test to job have to be to pass the legal test?

Could someone do an (awesome) academic study which shows that all programmers benefit from g, or at least that all developers in x language do? Or add some specific problem where g is hugely useful (algorithm design?) and then make that problem a requirement for many programming positions?

There would be a huge benefit to technology hiring if we could start using a cheap, standard test result vs. relying on proxies like school admittance (where they can screen for IQ), or expensive work-sample tests (which burn more of the applicant's time, selecting against busy/good candidates).

I'd rather advantage poor, possibly non-US, high-IQ, busy applicants over either graduates of elite schools (correlated with rich) or people willing to spend the time to take a 4-40 hour unpaid assignment.

Re:One hiring filter that works by jarrettcoggin on Friday April 06, 2012 @11:26AM (#3807478)
I applied at Company A that had an test similar to an IQ test, and they returned back that I would be better suited to an entirely different job than what I had applied for. It also took them 3 full weeks to get this information back to me, then another 3 months to determine that they wanted to interview me for the original position I had applied for. At that point, I was already working at Company B making 10k more than Company A said I would be eligible to earn after working at their company for 3 years.

Yeah, I'd pretty much say that the IQ test was pointless in this case and luckily that was the only company I had run into using it.

EDIT: Forgot to mention that the test also took 3 hours to go through and had no limit on the questions that you would get. There was no possible way you could finish every question on the test.

Re:One hiring filter that works by john_horton on Friday April 06, 2012 @11:10AM (#3807400)
This is interesting - do you have a good academic reference for that summarizes this literature? Maybe like a handbook chapter?
Re:One hiring filter that works by keenans on Friday April 06, 2012 @11:33AM (#3807522)
I think the the study he is referencing is the 1998 paper by Schmidt & Hunter. We studied it in business school. I couldn't find an actual copy of the paper but these two articles have abstracts of the findings: http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&id=1... http://www.onetest.com.au/awms/Upload/documents/whitepapers/...

Schmidt, F.L. & Hunter, J.E. (1998) The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings,” Psychological Bulletin,

Re:One hiring filter that works by tokenadult on Friday April 06, 2012 @01:56PM (#3808164)
Thanks. I had read the conclusion I mentioned in monographs about psychology I was reading for other research interests, and I'm glad you cited a key review article. I found the article's full text

http://mavweb.mnsu.edu/howard/Schmidt%20and%20Hunter%201998%...

via Google Scholar.