News for hackers. Stuff that matters.

A comment on Meta AI chief says large language models will not reach human intelligence. Parent comment

Re:Meta AI chief says large language models will not reach h... by opprobium on Wednesday May 22, 2024 @12:53PM (#40443178)
Recent example of a proof regarding theoretical limitations of Transformers: https://aclanthology.org/2023.tacl-1.31.pdf (also extended to cover SSMs https://arxiv.org/pdf/2404.08819)
[ Parent | on HN ]
Re:Meta AI chief says large language models will not reach h... by mewpmewp2 on Wednesday May 22, 2024 @12:59PM (#40443272)
I'm not sure if this paper corresponds to limits on what it can answer with a single or few tokens, but also the limits where LLM itself is allowed to produce more tokens (chain of thought) as well as use tools (coding) to solve problems?
[ Parent | on HN ]