News for hackers. Stuff that matters.
Re:Large Enough – Mistral AI by onlyrealcuzzo on Wednesday July 24, 2024 @03:19PM (#41060802)
> Like, that has nothing to do with their intelligence.

Because they don't have intelligence.

If they did, they could count the letters in strawberry.

Re:Large Enough – Mistral AI by TwentyPosts on Wednesday July 24, 2024 @03:22PM (#41060825)
People have been over this. If you believe this, you don't understand how LLMs work.

They fundamentally perceive the world in terms of tokens, not "letters".

Re:Large Enough – Mistral AI by antonvs on Wednesday July 24, 2024 @03:34PM (#41060984)
> If you believe this, you don't understand how LLMs work.

Nor do they understand how intelligence works.

Humans don't read text a letter at a time. We're capable of deconstructing words into individual letters, but based on the evidence that's essentially a separate "algorithm".

Multi-model systems could certainly be designed to do that, but just like the human brain, it's unlikely to ever make sense for a text comprehension and generation model to work at the level of individual letters.