News for hackers. Stuff that matters.
Re: by Gigachad on Tuesday March 03, 2026 @01:55AM (#47229044)
At work the conversation is that simultaneously everyone is using LLMs now, yet we receive virtually no traffic through them. The LLMs scrape our data, provide an answer to the user, and we see nothing from it.
Re: by jrmg on Tuesday March 03, 2026 @02:00AM (#47229083)
I have the same worry about LLMs in general - I know that ‘model collapse’ seems to be an unfashionable idea, but when the internet’s just full of garbage (soon?…), what are we going to train these things on?
Re: by tehjoker on Tuesday March 03, 2026 @09:26AM (#47232838)
They moved away from raw text and are now working with verifiable synthetic data (eg math, games, code) to improve general reasoning.
Re: by Barbing on Tuesday March 03, 2026 @02:26AM (#47229276)
How often are they scraping?

Also generally wondering… Do labs view scraping as legally safer than trying to cache the Internet? I figure it’s easy to mark certain content as all but evergreen (can do a quick secondary check for possible new news).

Maybe caching everything is too expensive?