News for hackers. Stuff that matters.
Re:Anthropic reverses privacy stance, will train on Claude c... by int_19h on Friday August 29, 2025 @03:17PM (#45068227)
LLMs can and do sometimes regurgitate parts of training data verbatim - this has been demonstrated many times on things ranging from Wikipedia articles to code snippets. Yes, it is not particularly likely for that damning private email of yours to be memorized, but if you throw a dataset with millions of private emails onto a model, it will almost certainly memorize some of them, and nobody knows what exact sequence of input tokens might trigger it to recite.
Re:Anthropic reverses privacy stance, will train on Claude c... by ljosifov on Saturday August 30, 2025 @04:20AM (#45072902)
That's a consideration, for sure. But given the LLM-s have not got the ground truth, everything is controlled hallucination, then - if the LLM tells you an imperfect version of my email or chat, you can never be sure if what the LLM told you is true, or not. So maybe you don't gain that much extra knowledge about me. For example, you can reasonably guess I'm typing this on the computer, and having coffee too. So if you ask the LLM "tell me a trivial story", and LLM comes back with "one morning, LJ was typing HN replies on the computer while having his morning coffee" - did you learn that much new about me, that you didn't know or could guess before?
Re:Anthropic reverses privacy stance, will train on Claude c... by int_19h on Monday September 01, 2025 @09:13PM (#45098103)
There are ways to tell if something is a hallucination or not if you can see all logit probabilities (hallucinations tend to be closer to noise). I'm sure there are other, more advanced statistical analysis methods.