News for hackers. Stuff that matters.
Re:GPT-5.5 by andai on Sunday April 26, 2026 @02:05PM (#47912409)
Look into Common Crawl and see what kind of quality content we are feeding these things. 4chan is just the tip of the iceberg (but it will happily answer all your questions, because it's seen everything).
Re:GPT-5.5 by ccgreg on Sunday April 26, 2026 @06:33PM (#47915461)
I don't know of anyone who uses Common Crawl as pre-training data without filtering it. We have an annotation system that lets people pick and choose which subsets they'd like to use.