Re:AI 'godfather' LeCun has 'zero concerns' about human exti...
by lawandjustice on Sunday October 04, 2026 @10:25AM
(#49954207)
I dont think so. This is akin to asking a person, what is the frequency of the light hitting your eye when watching a leaf for example.
You either know the (approximate) answer by knowing the frequency of green, or use a tool to measure it.
If the LLM gives the correct answer it is either.guessing based on intution(and this intuition is based on pairs of word to tokenization length in text form in training data), writing code(or executing a tokenizer) or running a tokenizer mentally (reasoning via CoT).
I've never tried it and it might take some thought and effort to conduct an experiment to find out properly, but I would be interested in the answer.