News for hackers. Stuff that matters.

A comment on Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book. Parent comment

Re:Meta's Llama 3.1 can recall 42 percent of the first Harry... by chiph2o on Sunday June 15, 2025 @02:12PM (#44283963)
This means that if we start with 50% of the book then there is 42% chance that we can recreate the remaining 50%.

What is the distinction between understanding and memorization? What is the chance that understanding results in memorization (may be in case of humans)?

[ Parent | on HN ]
Re:Meta's Llama 3.1 can recall 42 percent of the first Harry... by ipaddr on Monday June 16, 2025 @01:50AM (#44286926)
It stores how often characters will come next based on how often they happen in copyright material. It can reproduce parts because those values are a fingerprint.

It should break copyright laws as written now but too much money involved.

[ Parent | on HN ]