Re:Ask HN: Why don't Google/Amazon/Meta/Apple even try to co...
by behnamoh on Saturday February 04, 2023 @10:45AM
(#34655285)
Training costs of large models are prohibitive. Only the big tech can afford to make insanely large models.
[ Parent
| on HN ]
Re:Ask HN: Why don't Google/Amazon/Meta/Apple even try to co...
by smoldesu on Saturday February 04, 2023 @10:48AM
(#34655310)
You don't need to. As I said, there are freely-available, pre-trained GPT models you can run on your own computer: https://huggingface.co/EleutherAI/gpt-neo-2.7B
No one has a monopoly on LLMs. You just can't run OpenAI's latest-and-greatest, because... why should you?
Re:Ask HN: Why don't Google/Amazon/Meta/Apple even try to co...
by behnamoh on Saturday February 04, 2023 @10:55AM
(#34655353)
GPT-3's performance is much much better than any open-source alternative that I've tried (Bloom, GPT-J, etc.) which is mostly due to parameter size. Like I said, OpenAI has the monopoly in "large" language models, but of course you can have smaller models.