News for hackers. Stuff that matters.
Re:Gigatoken: Fastest Tokenizer by ramon156 on Wednesday July 22, 2026 @07:03AM (#49004797)
Doesn't really explain why its faster. "Optimizing for every kind of CPU" is not really enough info.

Cool project nonetheless, I will go through the code later tomorrow

There are no comments on this comment yet.