News for hackers. Stuff that matters.

A comment on Ask HN: When will we hit a limit on LLM performance?.

Re:Ask HN: When will we hit a limit on LLM performance? by smartician on Friday June 14, 2024 @01:52PM (#40683078)
Research seems to suggest we need exponential training data volume increases to see meaningful performance gains: https://arxiv.org/abs/2404.04125

Personally I think we've already hit a ceiling.

[ Parent | on HN ]
Re:Ask HN: When will we hit a limit on LLM performance? by p1esk on Friday June 14, 2024 @09:45PM (#40686845)
We have pretty much infinite training data available on YouTube. We can scale by many orders of magnitude before we run out of data. Why do you think we hit a ceiling?
[ Parent | on HN ]