Re:I'm Becoming AI-Blind
by john01dav on Friday August 21, 2026 @06:27PM
(#49394481)
> There's some psychological mechanism by which my brain immediately recognizes AI generated text and just short-circuits to "there is no information here".
The roots of llm math in part lie in compressing natural language such that there's only information there, and then running the reverse to create way more text without new information in a somewhat precise theoretical sense.
Re:I'm Becoming AI-Blind
by Ohentis on Friday August 21, 2026 @06:56PM
(#49394728)
I love 3b1b and I love that video, but that also isn't exactly what is being said. In particular llm inference does add information (in the meaning in this context) because the output distribution is sampled randomly.
The roots of llm math in part lie in compressing natural language such that there's only information there, and then running the reverse to create way more text without new information in a somewhat precise theoretical sense.
Some more information: https://youtu.be/l6DKRf-fAAM