News for hackers. Stuff that matters.

A comment on Large Enough – Mistral AI. Parent comment

Re:Large Enough – Mistral AI by mirekrusin on Wednesday July 24, 2024 @04:15PM (#41061532)
Not letters, but tokens. Think that it's translating everything to/from Chinese.
[ Parent | on HN ]
Re:Large Enough – Mistral AI by abdullahkhalids on Wednesday July 24, 2024 @04:43PM (#41061849)
How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other?

[1] Suggestion from chatgpt3.5 for new fruit name.

[ Parent | on HN ]
Re:Large Enough – Mistral AI by roywiggins on Wednesday July 24, 2024 @05:56PM (#41062614)
Illiterate humans can come up with new words like that too without being able to spell, LLMs are modeling language without precisely modeling spelling.
[ Parent | on HN ]