News for hackers. Stuff that matters.
Re:My local model setup on an M4 Pro Mac Mini by lwsio on Wednesday September 02, 2026 @06:05AM (#49534150)
I'm the author - hello! Added to the post! Qwen averages 325 tok/s in processing prompts, and 34 tok/s in token generation. That isn't instant, but it's quick enough that I never really think about it.

There are no comments on this comment yet.