News for hackers. Stuff that matters.

A comment on AI Detectors Falsely Accuse Students of Cheating–With Big Consequences. Parent comment

Re:AI Detectors Falsely Accuse Students of Cheating–With Big... by ordu on Monday October 21, 2024 @07:38AM (#41903033)
> It was always a cost saving measure because allocating 30min face to face time with each individual student for each class is such a gigantic cost for the institution that they cannot even imagine doing it.

So the obvious solution is to make students to talk with an AI, which would grade their performance. Or, maybe the grading itself could be done by a minimum wage assistant, while AI would lead the discussion with a student.

[ Parent | on HN ]
Re:AI Detectors Falsely Accuse Students of Cheating–With Big... by lukan on Monday October 21, 2024 @07:55AM (#41903157)
I hope that was sarcasm?
[ Parent | on HN ]
Re:AI Detectors Falsely Accuse Students of Cheating–With Big... by ordu on Monday October 21, 2024 @08:47AM (#41903590)
Probably. I'm not sure myself.

It is, because I'm becoming tired with the current AI hype. It lasts too long to be funny.

OTOH, professor talking with a student is a good way to assess the academic performance of the student, but there are some caveats beyond costs. For example, professor will struggle to be an objective judge. Moreover even if they succeed, they would face accusations of discrimination in any case.

AI could solve this problem, but I'm not sure if AIs will be up to a task of leading the discussion. Though maybe if you try to assess students on their ability to catch AI on a hallucinated bullshit...

[ Parent | on HN ]
Re:AI Detectors Falsely Accuse Students of Cheating–With Big... by lukan on Monday October 21, 2024 @09:22AM (#41903905)
"OTOH, professor talking with a student is a good way to assess the academic performance of the student, but there are some caveats beyond costs"

Why not have the testing done externally, by really neutral persons?

But AIs and especially LLMs are way too unreliable for the foreseeable future.

[ Parent | on HN ]
Re:AI Detectors Falsely Accuse Students of Cheating–With Big... by michaelmrose on Monday October 21, 2024 @10:05AM (#41904303)
Actually deliberately introducing confidently delivered and reasonable sounding bullshit sounds like a fantastic way to suss out who knows their topic.
[ Parent | on HN ]