News for hackers. Stuff that matters.
Re:What happens when an LLM never sees material beyond fifth... by spwa4 on Sunday August 16, 2026 @05:52AM (#49318513)
> 1) If an LLM says, "I don't know" its underlying data said it as well.

Nope. Emergent behavior exists and at this point dominates LLM behavior. Most of the stuff LLMs say they never learned (they are, always, imitating many different sources at the same time)

... which imho is exactly what humans do.

Re:What happens when an LLM never sees material beyond fifth... by chrisjj on Sunday August 16, 2026 @08:28AM (#49319434)
> Emergent behavior exists and at this point dominates LLM behavior.

Better to say emergent behavior exists and at this point dominates gulled LLM users' behavior.

LLM output is not emergent behaviour. Its simply word prediction with some randomness.

Re:What happens when an LLM never sees material beyond fifth... by Marha01 on Sunday August 16, 2026 @09:02AM (#49319669)
> Its simply word prediction with some randomness.

Word prediction with some randomness can lead to emergent behavior, depending on the specifics (complexity and scale) of the used prediction logic.

Re:What happens when an LLM never sees material beyond fifth... by chrisjj on Sunday August 16, 2026 @01:45PM (#49322056)
I've seen no example of emergent behaviour dominatimg LLM output.
Re:What happens when an LLM never sees material beyond fifth... by lostmsu on Sunday August 16, 2026 @10:15AM (#49320311)
No, it would have been better to say "I don't know"
Re:What happens when an LLM never sees material beyond fifth... by spwa4 on Sunday August 16, 2026 @09:11AM (#49319732)
> LLM output is not emergent behaviour. Its simply word prediction with some randomness.

And this very claim is "simply" the result of a neurotranmitter-moderated Natrium - Potassium ion cascade across a semipermeable membrane.