News for hackers. Stuff that matters.

A comment on I Asked ChatGPT to Explain Some Jokes to Me. Parent comment

Re:I Asked ChatGPT to Explain Some Jokes to Me by decremental on Saturday December 17, 2022 @12:48PM (#34030205)
https://beta.openai.com/tokenizer

Test with: 6f6b25515e18b4c41927e2dce3ffc589

You'll see that it spits out single character tokens.

[ Parent | on HN ]

There are no comments on this comment yet.