News for hackers. Stuff that matters.

A comment on LLMs use a surprisingly simple mechanism to retrieve some stored knowledge. Parent comment

Re:LLMs use a surprisingly simple mechanism to retrieve some... by ldjkfkdsjnv on Thursday March 28, 2024 @02:47PM (#39855810)
Cannot understand people claiming we are in a local maxima, when we literally had an ai scientific breakthrough only in the last two years.
[ Parent | on HN ]
Re:LLMs use a surprisingly simple mechanism to retrieve some... by xanderlewis on Thursday March 28, 2024 @04:05PM (#39856681)
Which breakthrough in the last two years are you referring to?
[ Parent | on HN ]
Re:LLMs use a surprisingly simple mechanism to retrieve some... by ldjkfkdsjnv on Thursday March 28, 2024 @04:47PM (#39857118)
the LLM scaling law
[ Parent | on HN ]
Re:LLMs use a surprisingly simple mechanism to retrieve some... by 6gvONxR4sf7o on Thursday March 28, 2024 @07:18PM (#39858632)
If you had to reduce it to one thing, it's probably that language models are capable few shot and zero shot learners. In other words, training a model to simply predict the next word on naturally occurring text, you end up with an tool you can use for generic tasks, roughly speaking.
[ Parent | on HN ]
Re:LLMs use a surprisingly simple mechanism to retrieve some... by xyzzy_plugh on Thursday March 28, 2024 @10:13PM (#39859865)
It turns out a lot of tasks are predictable. Go figure.
[ Parent | on HN ]