News for hackers. Stuff that matters.
Re:A 10 year old Xeon is all you need (for 26B-A4B MTP Draft... by cafkafk on Monday June 01, 2026 @03:37AM (#48353713)
That is a very fair point! I just ran a not very scientific benchmark with the system under load, and posted the raw logs in a sibling comment above, but the short answer is that it's hitting 11.94 tokens per second for generation - while it's also being a binary cache and CI build server.

Totally just vibes based, I think it goes up to 20+ tps when it's not under load (and that's me trying to be conservative). For context, reading speed at 250 wpm would be around 5 to 6 tokens per second.

Re:A 10 year old Xeon is all you need (for 26B-A4B MTP Draft... by Eonexus on Monday June 01, 2026 @03:40AM (#48353731)
Huh, that's actually not bad at all! Sure, it's not at the speed of a GPU, but still, 20 tps is cromulent for a CPU.