News for hackers. Stuff that matters.
Re:33-46% of workers on MTurk used LLMs in a text production... by AndrewKemendo on Wednesday June 14, 2023 @02:22PM (#36330249)
The fact that MTurkers are paid makes them unreliable for reflecting genuine human responses.

That they can’t replicate indicates that the sampling population isn’t consistent representation of population demographics and so there’s no real signal there that can be applied to a general population like most failure to replicate studies

Re:33-46% of workers on MTurk used LLMs in a text production... by mahathu on Wednesday June 14, 2023 @02:29PM (#36330396)
The person you replied to was being sarcastic, but you're still right.
Re:33-46% of workers on MTurk used LLMs in a text production... by incrudible on Wednesday June 14, 2023 @02:27PM (#36330360)
Not paying would be a heavy bias, too. Do we need something like jury duty?