News for hackers. Stuff that matters.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by QuercusMax on Friday April 21, 2023 @09:37AM (#35653546)
But isn't that half the reason people are so excited about this stuff - that you can ask it to make up an episode and it does a plausible job.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by crop_rotation on Friday April 21, 2023 @09:45AM (#35653652)
That is beside the point. My point is that detecting hallucinations seems like a very very hard problem.

The utility of it is there and has nothing to do with making up episodes instead of quoting the current one. Like you can ask it to write new episodes with specific settings and specific constraints. Hallucination is not the value add. Nobody is excited because it hallucinates. People are excited despite it since the other value add is too much.

Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by QuercusMax on Friday April 21, 2023 @09:58AM (#35653846)
But hallucinations are exactly the same thing as asking it to write a spec script.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by thfuran on Friday April 21, 2023 @10:01AM (#35653896)
But deliberately requesting and receiving content generation is altogether different from requesting a factual answer and receiving plausible-seeming nonsense. Or at least, it's different to the person asking; it's the same thing as far as the model is concerned.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by QuercusMax on Friday April 21, 2023 @11:13AM (#35655002)
Precisely my point.