News for hackers. Stuff that matters.
Re:Run Kimi K3 using 29 GB of RAM at 0.50 tok/s by rcxdude on Saturday August 01, 2026 @04:20PM (#49138042)
It is worth thinking about, when you're buying something, how much of what you're paying is the supplier's margin. And whether they have efficiency advantages over you doing it yourself. But for large LLMs it does seem like there's a pretty big efficiency advantage to the rack-scale hardware in datacenters compared to hacks like this.

There are no comments on this comment yet.