Re:Why Meta’s latest large language model survived only thre...
by vba616 on Friday November 18, 2022 @06:42PM
(#33664582)
People have been expressing surprise about this issue with computing machinery for 200 years.
Re:Why Meta’s latest large language model survived only thre...
by mfld on Saturday November 19, 2022 @03:51AM
(#33668377)
1. There is a large corpus of scientific publications.
2. Thanks to scihub et al, it is possible to download them en masse.
3. It is now feasible to train good language models on a large text corpus.
4. Wouldn't it be interesting to see what a model trained on this data comes up with? Maybe even new connections in existing knowledge?
Re:Why Meta’s latest large language model survived only thre...
by neweroldguy on Saturday November 19, 2022 @04:40AM
(#33668623)
> How would anyone think releasing this was a good idea?
Why would it not be? A model built on any consistent large data set could be interesting I’d expect.
But just because the data set has some semantic property, that doesn’t mean that a model built from it will necessarily generate text that had the same property (in this case, “being scientifically correct”). The real question is why would anyone think that?
How would anyone think releasing this was a good idea?