Re:Apple has new Mac app coming to make running local AI mod...
by datadrivenangel on Wednesday November 11, 2026 @10:55AM
(#50454887)
The larger Gemma4 and Qwen models are competattive with GPT3 / 3.5 maybe 4o, so you can run the original ChatGPT experience on a nice consumer device now.
Re:Apple has new Mac app coming to make running local AI mod...
by Foobar8568 on Wednesday November 11, 2026 @11:22AM
(#50455170)
I am using everyday Gemma4 31b and Qwen 3.8 27b + 3.6 35b MoE.
Beside the 35b, the others are too slow to do anything vs cloud models, unless you have a local B200+. And the Qwen 35b has the reasoning capacity of a 2yo doing maths.
I wasn't "impressed" with any models for coding until 1year ago, only then they started to be "usuable" with the fault that we know and still exists.
Maybe when chip would infer at 10-20x the speed of a 5090 RTX, otherwise it's really..bad.