Re:ChatGPT Plugins
by wahnfrieden on Thursday March 23, 2023 @05:08PM
(#35281294)
openai wants to gatekeep access and use of their AI. so why would they ever release a local LLM? i think that would come from their enemies
they wouldn't ; i hope there will be an open source alternative. Firefox and chrome are open source
I mean, GPT3 requires some 800GB of memory to run, do we all have gazillion dollars supercomputers at home?
I think, unless there's some real breaktrough in the field or in the hw acceleration, this kind of model is going to stay locked behind a pricy API for quite some time.
GPT-3.5 requires less. And neither model is considered size-optimal. It's just that with Microsoft's money, it's easier for OpenAI to move fast by throwing said money at more hardware rather than trying to optimize for size.
And yeah, I wouldn't expect them to share any model that is competitive with their current offering. But it can leak, and the copyright situation around that is very unclear at the moment.
It may be doable - a chatbot with a lot of plugins does not need to know a lot of facts, just to have a good grasp of language. It can fetch its factual answers from the wikipedia plugin