News for hackers. Stuff that matters.

A comment on Single Digit Tokenization improves LLM Math abilities by up to 70x.

Re:Single Digit Tokenization improves LLM Math abilities by ... by Someone on Thursday October 19, 2023 @06:44AM (#37941007)
So, this makes numbers in text more numbery than stringy. As a side effect, will this make it more likely that a LLM will claim C99 (https://en.wikipedia.org/wiki/C99) is greater than C17 (https://en.wikipedia.org/wiki/C17_(C_standard_revision))?
[ Parent | on HN ]

There are no comments on this comment yet.