News for hackers. Stuff that matters.
Re:When Free Software Isn't Free Enough by lrvick on Wednesday November 18, 2026 @06:26PM (#50553799)
I could run larger models with fewer sessions, but with my cluster of 8x r9700s I get 12 sessions of qwen 3.8 flash next 135b at > 100tps each and that is the sweet spot for me.

With radiance and/or strata a single card is enough for one session though.

There are no comments on this comment yet.