Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models
by SillyUsername on Monday June 29, 2026 @07:26AM
(#48717842)
I don't know tbh, I run Qwen 3.6 27B, Q6, on two 5060TIs with 128K context (2 parallel, 256K total) and get better fairly good performance. It's not perfect, but that's why I also use a low quant Gemma 4 validation model to confirm outputs. It's probably comparable to early chatgpt in terms of ability.
It's far cheaper to spin up an H200 hourly or to simply consume a managed version of an open weights model than it is to use a proprietary hyperscaler API. And you own the model itself and can fine tune, tweak, lobotomize, etc.
The stuff you can run on your own RTX cards is neat, but it's rather hobbyist. The real power is in the cloud. Renting cloud hardware is fine, because the core problem is ownership of the weights, not the server rack or ISP fiber lines. Those are already commodity.
Big businesses will eventually run open weights models in the cloud, and it'll be a rather large part of the future AI economy.