Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on The GPT Architecture, on a Napkin. Parent comment
In many cases each word has a number/token associated with it, but some words get broken up into several tokens. Same with longer numbers.
You can check out their tokenizer under the following domain. It probably gives you an idea why GPT is not very good at dealing with numbers.
https://beta.openai.com/tokenizer
There are no comments on this comment yet.
In many cases each word has a number/token associated with it, but some words get broken up into several tokens. Same with longer numbers.
You can check out their tokenizer under the following domain. It probably gives you an idea why GPT is not very good at dealing with numbers.
https://beta.openai.com/tokenizer