Re:What does a leaked Google memo reveal about the future of...
by visarga on Sunday May 14, 2023 @06:36PM
(#35941976)
> I honestly don't think OSS is a big factor business-wise
Lots of companies are evaluating fine-tuning strategies for <60B LLMs. Such models can be efficient, private, cheaper and adapted to the use case. They may not be generalists like GPT-4, but you need them for scaling up usage on high volume calls on the same task if you don't want to have to pay a fortune to OpenAI.
For example a medical company can't use OpenAI because they are not allowed to send sensitive user data over external API. Same for processing confidential business data for B2B services.
Lots of companies are evaluating fine-tuning strategies for <60B LLMs. Such models can be efficient, private, cheaper and adapted to the use case. They may not be generalists like GPT-4, but you need them for scaling up usage on high volume calls on the same task if you don't want to have to pay a fortune to OpenAI.
For example a medical company can't use OpenAI because they are not allowed to send sensitive user data over external API. Same for processing confidential business data for B2B services.