Re:The Case That A.I. Is Thinking
by lossyalgo on Tuesday November 04, 2025 @04:36PM
(#45816161)
LLMs were not designed to count letters[0] since they work with tokens, so whatever trick they are now doing behind the scenes to handle this case, can probably only handle this particular case. I wonder if it's now included in the system prompt. I asked ChatGPT and it said it's now using len(str) and some other python scripts to do the counting, but who knows what's actually happening behind the scenes.
[0] https://arxiv.org/pdf/2502.16705