News for hackers. Stuff that matters.

A comment on Ilya Sutskever to leave OpenAI. Parent comment

Re:Ilya Sutskever to leave OpenAI by astrange on Wednesday May 15, 2024 @04:19AM (#40364398)
LLMs could count the number of letters in a sentence if you stopped tokenizing them first.
[ Parent | on HN ]
Re:Ilya Sutskever to leave OpenAI by HarHarVeryFunny on Wednesday May 15, 2024 @07:54AM (#40365693)
tokenization is not the issue - these LLMs can all break a word into letters if you ask them.
[ Parent | on HN ]