News for hackers. Stuff that matters.

A comment on Gigatoken: Fastest Tokenizer.

Re:Gigatoken: Fastest Tokenizer by convexstrictly on Tuesday July 21, 2026 @08:14PM (#49000160)
GitHub: https://github.com/marcelroed/gigatoken
[ Parent | on HN ]
Re:Gigatoken: Fastest Tokenizer by Alifatisk on Wednesday July 22, 2026 @05:58AM (#49004243)
They even added a section ”AI Use Disclosure”, beautiful!
[ Parent | on HN ]