Re:Elon Musk drops suit against OpenAI and Sam Altman
by Zambyte on Wednesday June 12, 2024 @02:00AM
(#40655008)
It's crazy how good open weight models are already. With a 7900 XTX I can run a roughly GPT-3.5 quality q6 model at 70 TPS. FP16 at 30 TPS. I can swap out the model to cater to specific tasks.
Sure, it's nowhere near the amount of knowledge as Claude Sonnet / Opus, or the suite of GPT 4s, but when you hook it up to external sources of knowledge, it's still freaking useful.
Re:Elon Musk drops suit against OpenAI and Sam Altman
by Havoc on Wednesday June 12, 2024 @04:54AM
(#40655977)
> I can't imagine a future where AI is only controlled by the powerful and wealthy.
No need to imagine. It’s already here. Look at all the open weight models - all big corporate developed and then shared because it suited their corporate objectives.
There is not a hint of FOSS like organic model development in sight. On the technique and research yes but not on the actual training.
It’s too expensive and thus automatically limited to big tech and gov
I can't imagine a future where AI is only controlled by the powerful and wealthy.
Honestly, we take many of the great things we have thanks to FOSS for granted and come to think of it, if those were to be invented today, they would be locked behind a subscription fee or entirely discontinued because VC's couldn't figure out how to make money from them.