News for hackers. Stuff that matters.

A comment on Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book. Parent comment

Re:Meta's Llama 3.1 can recall 42 percent of the first Harry... by colechristensen on Monday June 16, 2025 @12:13AM (#44286560)
>Amassing troves of copyrighted works illegally into a ZIP file wouldn’t be allowed. The fact that the meaning was compressed using “Math” makes everyone stop thinking because they don’t understand “Math”.

LLMs are in reality the artifacts of lossy compression of significant chunks of all of the text ever produced by humanity. The "lossy" quality makes them able to predict new text "accurately" as a result.

>compressed using “Math”

This is every compression algorithm.

[ Parent | on HN ]

There are no comments on this comment yet.