News for hackers. Stuff that matters.
Re:LLMs Are This Close to Destroying the Internet by marginalia_nu on Sunday April 14, 2024 @12:52PM (#40032478)
Adding to this, the Internet is extremely noisy and polluted with all manner of crap, this has been the status quo for over a decade.

The notion that you could just grab data off the internet completely unvetted, and then train a useful model off that data seems very unrealistic. To get anything useful out of real world crawl data, you need a lot of filtering and processing to select the good bits. This is true if you're training an AI or building a search engine.

There are no comments on this comment yet.