News for hackers. Stuff that matters.
Re:I don't care how well your "AI" works by vrighter on Wednesday November 26, 2025 @10:52AM (#46058630)
better integrations won't do anything to fix the fact that these tools are, by their mathematical nature, unreliable and always will be
Re:I don't care how well your "AI" works by blackqueeriroh on Thursday November 27, 2025 @02:04AM (#46066540)
so are people
Re:I don't care how well your "AI" works by vrighter on Thursday November 27, 2025 @10:03AM (#46069882)
But humans have vastly lower error rates than llms. And in a multi-step process that means that those error rates compound. And when that happens, you end up with a 50/50 or worse
Re:I don't care how well your "AI" works by danaris on Thursday November 27, 2025 @02:12PM (#46072334)
And, more importantly, a given human can, and usually will, learn from their mistakes and do better in a reasonably consistent pattern.

And when humans do make mistakes, they're also in patterns that are fairly predictable and easy for other humans to understand, because we make mistakes due to a few different well-known categories of errors of thought and behavior.

LLMs, meanwhile, make mistakes simply because they happen to have randomly generated incorrect text that time. Or, to look at it another way, they get things right simply because they happen to have randomly generated correct text that time.

Individual humans can be highly reliable. Humans can consciously make tradeoffs between speed and reliability. Individual unreliable humans can become more reliable through time and effort.

None of these are true of LLMs.