News for hackers. Stuff that matters.
Re:Legal models hallucinate in 1 out of 6 (or more) benchmar... by tines on Friday May 31, 2024 @04:47PM (#40540063)
Not really. It distinguishes LLM output from human output even though they look the same sometimes. The process by which something comes into existence is a valid distinction to make, even if the two processes happen to produce the same thing sometimes.
Re:Legal models hallucinate in 1 out of 6 (or more) benchmar... by williamcotton on Friday May 31, 2024 @04:51PM (#40540099)
Why is it a valid distinction to make?

For example, does this distinction affect the assessed truthfulness of a signal?

Does process affect the artfulness of a painting? “My five year old could draw that?”

Re:Legal models hallucinate in 1 out of 6 (or more) benchmar... by tines on Friday May 31, 2024 @04:53PM (#40540116)
It makes sense to do so in the same way that it’s useful to distinguish quantum mechanics from classical mechanics, even if they make the same predictions sometimes.
Re:Legal models hallucinate in 1 out of 6 (or more) benchmar... by williamcotton on Friday May 31, 2024 @05:03PM (#40540212)
A proposition of any kind of mechanics is what can be true or false. The calculations are not what makes up the truth of a proposition, as you’ve pointed out.