News for hackers. Stuff that matters.
Re:Legal models hallucinate in 1 out of 6 (or more) benchmar... by throw46365 on Saturday June 01, 2024 @02:28PM (#40547983)
But the errors are fundamental, and the successes actually subjective as a result.

That is, it appears to get things right, really a lot, but the conclusions people draw about why it gets things right are undermined by the nature of the errors.

Like, it must have a world model, it must understand the meaning of... etc.; the nature of the errors they are downplaying fundamentally undermines the certainty of these projections.

There are no comments on this comment yet.