Re:Open source ChatGPT with LLaMA implementation trains 15x ...
by sinity on Friday March 03, 2023 @01:42AM
(#35006564)
> This obsession with locking up model weights behind a gate-keeping application form and calling it open source is weird. I don't know who the high priests are trying to fool.
When they don't do it, people scream at them (see Galactica)
"Journalists" react like this:
> On November 15 Meta unveiled a new large language model called Galactica, designed to assist scientists. But instead of landing with the big bang Meta hoped for, Galactica has died with a whimper after three days of intense criticism. Yesterday the company took down the public demo that it had encouraged everyone to try out.
> Meta’s misstep—and its hubris—show once again that Big Tech has a blind spot about the severe limitations of large language models. There is a large body of research that highlights the flaws of this technology, including its tendencies to reproduce prejudice and assert falsehoods as facts.
> However, Meta and other companies working on large language models, including Google, have failed to take it seriously.
When they don't do it, people scream at them (see Galactica)
"Journalists" react like this:
> On November 15 Meta unveiled a new large language model called Galactica, designed to assist scientists. But instead of landing with the big bang Meta hoped for, Galactica has died with a whimper after three days of intense criticism. Yesterday the company took down the public demo that it had encouraged everyone to try out.
> Meta’s misstep—and its hubris—show once again that Big Tech has a blind spot about the severe limitations of large language models. There is a large body of research that highlights the flaws of this technology, including its tendencies to reproduce prejudice and assert falsehoods as facts.
> However, Meta and other companies working on large language models, including Google, have failed to take it seriously.
Yann LeCunn confirmed this: https://twitter.com/pmarca/status/1631185701864865792
I wonder if they just leaked it onto 4chan themselves, lol.