News for hackers. Stuff that matters.
Re:OpenAI is too cheap to beat by vsreekanti on Thursday October 12, 2023 @02:53PM (#37861405)
Yep, we agree that the obvious direction of innovation for OSS models is smaller and cheaper, likely at roughly the same quality: https://generatingconversation.substack.com/p/open-source-ll...
Re:OpenAI is too cheap to beat by smcleod on Thursday October 12, 2023 @03:37PM (#37862065)
Also more privacy respecting, and more customisable / flexible.
Re:OpenAI is too cheap to beat by wrsh07 on Thursday October 12, 2023 @09:11PM (#37865303)
I actually expect open source models will be small _but larger than they are today_ because phones and laptops will get dedicated chips and software for running eg the best open source (weights?) model

So eventually you could be running decent sized models locally (iOS could even provide an API with fine tuning etc)