News for hackers. Stuff that matters.
Re:Can AI do maths yet? Thoughts from a mathematician by spacemanspiff01 on Monday December 23, 2024 @08:34AM (#42494272)
I wonder if these are tokenization issues? I really am curious about metas byte tokenization scheme...
Re:Can AI do maths yet? Thoughts from a mathematician by jampekka on Monday December 23, 2024 @08:50AM (#42494357)
Probably mostly not. The errors tend to be logical/conceptual. E.g. mixing up scalars and matrices is unlikely to be from tokenization. Especially if using spaces between the variables and operators, as AFAIK GPTs don't form tokens over spaces (although tokens may start or end with them).