News for hackers. Stuff that matters.

A comment on ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?.

Re:ChatGPT: How many letters has the string “djsjcnnrjfkalcr”? by xaphod on Sunday January 08, 2023 @04:20AM (#34297458)
Text is broken into something called "tokens" [0] for GPT. It doesn't work on individual characters. That explains why it always fails these character counting questions.

[0]: https://help.openai.com/en/articles/4936856-what-are-tokens-...

[ Parent | on HN ]
Re:ChatGPT: How many letters has the string “djsjcnnrjfkalcr”? by nfcampos on Sunday January 08, 2023 @04:30AM (#34297510)
Interestingly both “halves” of the word as it split it have the same number of tokens
[ Parent | on HN ]
Re:ChatGPT: How many letters has the string “djsjcnnrjfkalcr”? by charcircuit on Sunday January 08, 2023 @04:23AM (#34297472)
>it always fails

It usually is able to get the answer within 1 character of the actual answer.

[ Parent | on HN ]