News for hackers. Stuff that matters.
Re:Google CEO says more than a quarter of the company's new ... by farseer on Thursday October 31, 2024 @02:53AM (#42004123)
Its not even been 2 years, and you think things are coming to a halt?
Re:Google CEO says more than a quarter of the company's new ... by 0points on Thursday October 31, 2024 @04:02AM (#42004441)
Yes. The models require training data and they already been fed the internet.

More and more of the content generated since is LLM generated and useless as training data.

The models get worse, not better by being fed their own output, and right now they are out of training data.

This is why Reddit just went profitable, AI companies buy their text to train their models because it is at least somewhat human written.

Of course, even reddit is crawling with LLM generated text, so yes. It is coming to a halt.

Re:Google CEO says more than a quarter of the company's new ... by CaptainFever on Thursday October 31, 2024 @07:25AM (#42005679)
Data is not the only factor. Architecture improvements, data filtering etc. matter too.
Re:Google CEO says more than a quarter of the company's new ... by simianparrot on Thursday October 31, 2024 @03:02AM (#42004152)
I know for a fact they are because rate _and_ quality of improvement is diminishing exponentially. I keep a close eye on this field as part of my job.