LLMs Can't Do Probability

Re:LLMs Can't Do Probability by zrezzed on Wednesday May 01, 2024 @07:25PM (#40230853)

I agree it’s equivalent, and that’s a great way to think about it.

But… I wouldn’t be surprised if humans answered closer to the LLM results than 80:20. I’d actually be surprised if humans converged very close to the right result.

Would be a fun mechanical Turk experiment to run.

[ Parent | on HN ]

Re:LLMs Can't Do Probability by godelski on Wednesday May 01, 2024 @08:44PM (#40231473)

> Would be a fun mechanical Turk experiment to run.

Sounds like it would be a good way to determine likelihood of MTurk users being LLMs.

[ Parent | on HN ]