News for hackers. Stuff that matters.

A comment on Show HN: LLaMA tokenizer that runs in browser. Parent comment

Re:Show HN: LLaMA tokenizer that runs in browser by oofsa on Wednesday June 14, 2023 @12:49AM (#36321577)
https://platform.openai.com/tokenizer is not for GPT-4 but GPT-3. https://tiktokenizer.vercel.app/ supports GPT-4.
[ Parent | on HN ]

There are no comments on this comment yet.