News for hackers. Stuff that matters.
Re:Gemini 4 Neon by hackingonempty on Wednesday November 18, 2026 @06:20PM (#50553755)

  Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)
  [ ... ]
  Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.
Google has been scanning every book they can get their hands on for 20 years or more. They have a bunch of patents on non-destructive book scanning gear. Surely they are using that data to train their models.
Re:Gemini 4 Neon by wahnfrieden on Wednesday November 18, 2026 @06:57PM (#50554079)
Surely they are destroying scanned books for training
Re:Gemini 4 Neon by mastax on Wednesday November 18, 2026 @09:36PM (#50555364)
They invented those nondestructive scanners before the court cases that effectively mandated destruction.
Re:Gemini 4 Neon by wahnfrieden on Wednesday November 18, 2026 @11:18PM (#50556031)
Why does that allow them to use the scans for LLM training? Those scans were used for a different purpose. I don’t understand the logic.
Re:Gemini 4 Neon by foohis on Wednesday November 18, 2026 @07:21PM (#50554290)
won't help if they also include trash internet text in the training set as well.
Re:Gemini 4 Neon by etoxin on Wednesday November 18, 2026 @07:57PM (#50554636)
it's kinda known that the gemini models write better english which goes against the "trash data" remarks.
Re:Gemini 4 Neon by Gareth321 on Thursday November 19, 2026 @01:17AM (#50556653)
Maybe not. If they’re trained on real world emails and Reddit comments, they’ll write more like “real” people, but they’ll be dumber.