News for hackers. Stuff that matters.

A comment on OpenAI’s CEO Says the Age of Giant AI Models Is Already Over. Parent comment

Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over by fpgaminer on Monday April 17, 2023 @07:45PM (#35608149)
I don't recall the Chinchilla paper disputing my point. They establish "training-compute optimal" scaling laws, but none of their findings suggest that loss hits any kind of asymptote.
[ Parent | on HN ]
Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over by midland_trucker on Tuesday April 18, 2023 @07:14AM (#35612438)
Perhaps we're talking past each other, is "loss threshold" a specific term in LLM literature?

Merely pointing out that the debate as to whether we are compute or data limited (OP) has not concluded at all; There are lots of compelling theories on relationship between the two.

[ Parent | on HN ]