Re:GigaToken: ~1000x faster Language model tokenization
by marcelroed on Thursday July 23, 2026 @11:23PM
(#49030900)
Yes! I will publish a Rust crate soon. If you have thoughts about how to structure the API I would love to hear them.
[ Parent
| on HN ]
There are no comments on this comment yet.