News for hackers. Stuff that matters.
Re:$500 GPU outperforms Claude Sonnet on coding benchmarks by Octoth0rpe on Thursday March 26, 2026 @11:07PM (#47538695)
> A single patched llama-server runs on K3s, providing both generation with speculative decoding (~100 tok/s)

There seems to be at least some detail on that point.

There are no comments on this comment yet.