News for hackers. Stuff that matters.

A comment on Understanding GPT Tokenizers. Parent comment

Re:Understanding GPT Tokenizers by weinzierl on Thursday June 08, 2023 @07:52PM (#36251044)
If anyone else is looking for the list parent is mentioning I assume it is: https://openaipublic.blob.core.windows.net/encodings/r50k_ba...
[ Parent | on HN ]

There are no comments on this comment yet.