News for hackers. Stuff that matters.
Re:55x Speedup of Andrej Karpathy's Minbpe LLM Tokenizer wit... by kuprel on Friday February 23, 2024 @12:06PM (#39483206)
The M2 Air was actually much faster than whatever CPU was on the cloud RTX4090 machine I rented. I chose the stronger benchmark to compare to
Re:55x Speedup of Andrej Karpathy's Minbpe LLM Tokenizer wit... by kuprel on Friday February 23, 2024 @03:16PM (#39485562)
Using int16 and an H100 the speedup is actually 108x over the M2 air