News for hackers. Stuff that matters.

A comment on Artificial intelligence is losing hype. Parent comment

Re:Artificial intelligence is losing hype by slidehero on Tuesday August 20, 2024 @08:14PM (#41305443)
>We are basically out of new, non-synthetic text to train models

this is not even remotely true.

There is an astronomical amount of data siloed by publishers, professional journals etc. that is yet to be tapped.

OpenAI is making inroads by making deals with these content owners for access to all that juicy data.

[ Parent | on HN ]
Re:Artificial intelligence is losing hype by staticman2 on Wednesday August 21, 2024 @08:38AM (#41309677)
>>>There is an astronomical amount of data siloed by publishers, professional journals etc. that is yet to be tapped.

You seem to think these models haven't already been trained on pirated versions of this content, for some reason.

[ Parent | on HN ]
Re:Artificial intelligence is losing hype by dartos on Wednesday August 21, 2024 @03:08PM (#41313203)
Yep, books3 is what llama was famously trained on before it was taken down.

That’s not even considering AI crawlers or all the copyright text on archive.org

[ Parent | on HN ]
Re:Artificial intelligence is losing hype by dartos on Wednesday August 21, 2024 @03:11PM (#41313230)
Even assuming there is a ton of data companies are just now getting access to, the logarithmic curve of LLM improvements is clearly visible (granted that our LLM evaluation frameworks are not very good)
[ Parent | on HN ]