News for hackers. Stuff that matters.
Re:Running Gemma 4 26B at 5 tokens/SEC on a 13-year-old Xeon... by aaulia on Thursday July 16, 2026 @02:47AM (#48931118)
I tried Qwen MoE a while back. Using my 8GB RX470, somehow got 10+ token/sec, lot's of trial and error with llama.cpp config, and it's still slow to be used for my usecase. Even at 12 to 16 IMO it's slow. For chat, maybe it's enough, but for any other tasks, it's not viable IMO

There are no comments on this comment yet.