News for hackers. Stuff that matters.
Re:MAI Code 2 and Code 2 Flash by AnotherGoodName on Tuesday November 17, 2026 @06:54PM (#50539969)
The worst thing for them would be if someone made reasonably priced hardware that could run the ‘near enough’ models like kimi or glm 5.3 or whatever the equivalent is in the future.

I think it’s inevitable. Hardware manufacturing will ramp up to meet a demand and the demand from consumers is there. The big providers can’t monopolize a commodity forever.

The biggest hope is HBF (high bandwidth flash) which has the bandwidth of HBM with the density of flash. It has much more latency but when you’re repeatedly pumping weights through a compute unit it’s not a blocker.

Re:MAI Code 2 and Code 2 Flash by mrinterweb on Tuesday November 17, 2026 @07:50PM (#50540431)
Qwen 3.8 flash next is pretty good. It is a pretty large MOE model that can be ran with Strata. That's the best local model I can run for now. I wish I could run deepseek v4.1 flash (1017), but that one is too big for my machine to run.

I swear people forget about inference providers that serve open weight models. It is hard to beat their prices. They are usually barely more expensive than electricity, so running local inference barely wins on cost (if you don't factor in the upfront hardware costs).