Re:MAI Code 2 and Code 2 Flash
by mrinterweb on Tuesday November 17, 2026 @07:50PM
(#50540431)
Qwen 3.8 flash next is pretty good. It is a pretty large MOE model that can be ran with Strata. That's the best local model I can run for now. I wish I could run deepseek v4.1 flash (1017), but that one is too big for my machine to run.
I swear people forget about inference providers that serve open weight models. It is hard to beat their prices. They are usually barely more expensive than electricity, so running local inference barely wins on cost (if you don't factor in the upfront hardware costs).
I think it’s inevitable. Hardware manufacturing will ramp up to meet a demand and the demand from consumers is there. The big providers can’t monopolize a commodity forever.
The biggest hope is HBF (high bandwidth flash) which has the bandwidth of HBM with the density of flash. It has much more latency but when you’re repeatedly pumping weights through a compute unit it’s not a blocker.