News for hackers. Stuff that matters.

A comment on Coconut by Meta AI – Better LLM Reasoning with Chain of Continuous Thought?. Parent comment

Re:Coconut by Meta AI – Better LLM Reasoning with Chain of C... by astrange on Tuesday December 31, 2024 @08:37AM (#42558613)
LLMs have no fixed internal representation - they barely have internal anything - so no, there is no translation.

But there's also no guarantee any particular query generalizes (vs is memorized), so it might only be able to answer some queries in some languages.

[ Parent | on HN ]
Re:Coconut by Meta AI – Better LLM Reasoning with Chain of C... by stingraycharles on Wednesday January 01, 2025 @03:22AM (#42564707)
Got it. And since my native language is arguably one of the closest to English (Dutch), it works very well. But probably not as well for, say, Asian which has completely different grammatical constructs.
[ Parent | on HN ]