News for hackers. Stuff that matters.

A comment on Show HN: TokenDagger – A tokenizer faster than OpenAI's Tiktoken.

Re:Show HN: TokenDagger – A tokenizer faster than OpenAI's T... by isjustintime on Monday June 30, 2025 @04:45PM (#44427659)
Very cool. We use Tiktoken and I'd love to see the performance impact. Pretty great decision to make it drop-in compatible.
[ Parent | on HN ]

There are no comments on this comment yet.