Re:We think this cool study we found is flawed. Help us repr...
by denton-scratch on Sunday May 01, 2022 @01:28PM
(#31226836)
> I guess most other people would read it that way
Not me. But as I said upthread, that's the only way I can construe the question as being coherent. And I agree that the question thus construed invites the experimental subject to make predictions about the behaviour of others; so the question tests the subject's accuracy in psychological judgements.
If you construe it as being a coherent question.
I think it's silly to construe it that way; I just think it was a crap question, and you can't draw any conclusions at all from the results.
I don't think it's a flawed instruction -- i.e., I believe most participants will read it as intended, and it will produce interesting results. I read it as follows:
"Suppose we show a person your sequence and a sequence generated via an actual random number generator. Minimize the average probability that that person correctly guesses which sequence was generated by a human, across all possible real random sequences."
I guess most other people would read it that way, even it is not formally correct from a statistical perspective. And I believe it gets at what they're trying to measure.