Re:OpenAI is too cheap to beat
by vsreekanti on Thursday October 12, 2023 @02:53PM
(#37861405)
Yep, we agree that the obvious direction of innovation for OSS models is smaller and cheaper, likely at roughly the same quality: https://generatingconversation.substack.com/p/open-source-ll...
[ Parent
| on HN ]
Also more privacy respecting, and more customisable / flexible.
I actually expect open source models will be small _but larger than they are today_ because phones and laptops will get dedicated chips and software for running eg the best open source (weights?) model
So eventually you could be running decent sized models locally (iOS could even provide an API with fine tuning etc)