News for hackers. Stuff that matters.

A comment on Tokens are a big reason today's generative AI falls short.

Re:Tokens are a big reason today's generative AI falls short by soloist11 on Saturday July 06, 2024 @03:03PM (#40892454)
This is like saying binary numbers are the reason generative AI falls short. Computers work with transistors which are either on or off so what are these people proposing as the next computational paradigm to fix the problems with binary generative AI?
[ Parent | on HN ]
Re:Tokens are a big reason today's generative AI falls short by mvdtnz on Saturday July 06, 2024 @03:37PM (#40892669)
What?
[ Parent | on HN ]
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Saturday July 06, 2024 @03:38PM (#40892678)
Tokenization as the main problem is a red herring. It's possible to get rid of the tokens entirely and train on byte sequences, it won't make a difference to why generative AI can't count or do basic arithmetic.
[ Parent | on HN ]