News for hackers. Stuff that matters.

A comment on Coconut by Meta AI – Better LLM Reasoning with Chain of Continuous Thought?. Parent comment

Re:Coconut by Meta AI – Better LLM Reasoning with Chain of C... by stingraycharles on Tuesday December 31, 2024 @07:45AM (#42558372)
Is everything in LLMs translated back to English before interpretation?

It works fairly well in my native language, I’m surprised to learn that things get translated back.

[ Parent | on HN ]
Re:Coconut by Meta AI – Better LLM Reasoning with Chain of C... by astrange on Tuesday December 31, 2024 @08:37AM (#42558613)
LLMs have no fixed internal representation - they barely have internal anything - so no, there is no translation.

But there's also no guarantee any particular query generalizes (vs is memorized), so it might only be able to answer some queries in some languages.

[ Parent | on HN ]
Re:Coconut by Meta AI – Better LLM Reasoning with Chain of C... by stingraycharles on Wednesday January 01, 2025 @03:22AM (#42564707)
Got it. And since my native language is arguably one of the closest to English (Dutch), it works very well. But probably not as well for, say, Asian which has completely different grammatical constructs.
[ Parent | on HN ]