Some of the questions were routine business questions, others were general questions about the material they read, and, the meat of the questions were ones on the moral consequences of executive decisions. It was expected that executives would answer all the questions correctly. Instead, the study scored based on how long it took them to answer the moral questions as opposed to the general questions. These scores were then compared against respondents from a control group of non-executives.
EDIT: Gosh! I hope I'm representing her study accurately... "Business Experience and Moral Awareness: When Less May be More", Jennifer Jordan (2005)
More info needed ASAP.
Takes a bit of scrolling down the page of results[1], but people are actually pretty honest on that one, the mode response is "Agree somewhat" (this finding is from our initial, seed sample).
Also agree about the ease of getting around this. Particularly if you're a psychopath, and are therefore good at being manipulative. The version of this test used in parole settings[2] deals with this by having professional interviewers who use the person's history and records to make assessments, in addition to the interview. (Note that I'm not actually defending that process; part of the point of this and NPR's recent discussions about psychopathy is to stimulate thinking about whether stuff like this should actually be used for important decisions like parole)
[1]: https://www.statwing.com/open/datasets/6beda395392cc4b0115e0...
[2]: http://en.wikipedia.org/wiki/Hare_Psychopathy_Checklist
edit: clarified that results from [1] are from initial seed sample of respondents, not the HN sample.
Psychology is a science, just like pizza is a vegetable.
Of course I'm still just not-executing-my-nonexistent-utility-function, but the point is that said utility function cares about people other than myself. In aggregate, more so than myself.
I've had this exact same thought before. I love manipulating people's feelings in certain ways. I like making people have fun. If you're in a bad mood and someone goes out of their way to try and put you in a good mood they have intentionally manipulated you.
That apparently puts me in the 9th decile. Weird, because I usually come up as neutral or chaotic good on alignment tests.
I know if I put "strongly agree," it'll be more likely to call me a psychopath. At the same time, I'm thinking, "I look out for people I love - sometimes at risk to myself - but ultimately that's only because they matter to ME. Looking out for others is undeniably motivated by what matters to me."
Aside from the false dichotomies, surely any psychopath with even a shred of intelligence could answer strategically and defeat the test's intended purpose. And they use this in prison hearings?