News for hackers. Stuff that matters.

A comment on Prediction: AI will make formal verification go mainstream. Parent comment

Re:Prediction: AI will make formal verification go mainstream by 8note on Tuesday December 16, 2025 @05:55PM (#46295840)
the question remains: is the tokenizer going to be a fundamental limit to my task? how do i know ahead of time?
[ Parent | on HN ]
Re:Prediction: AI will make formal verification go mainstream by worldsayshi on Tuesday December 16, 2025 @06:09PM (#46295996)
Would it limit a person getting your instructions in Chinese? Tokenisation pretty much means that the LLM is reading symbols instead of phonemes.

This makes me wonder if LLMs works better in Chinese.

[ Parent | on HN ]