Re:Are language models deprived of electric sleep?
by benreesman on Saturday July 23, 2022 @11:45AM
(#32204377)
I sometimes fine tune new language models on the HN comment corpus for fun.
It generates comments arguing that ML models are just parrots.
Re:Are language models deprived of electric sleep?
by Swizec on Saturday July 23, 2022 @12:16PM
(#32204687)
As a bird owner, they are not “just parrots”. There is clear intent to communicate. Even species who can’t say human words use distinct vocalizations for specific purposes and situations.
Re:Are language models deprived of electric sleep?
by benreesman on Saturday July 23, 2022 @01:59PM
(#32205789)
I didn’t say that fine-tuned language models have enlightened opinions about living things, just that they produce comments indistinguishable to me from the GP :)
But when doing actual research, we check our work against the real world. For example, that's how you get a list of real references rather than fake ones.
Suppose we played a guessing game: given a title, does the Wikipedia article exist or not? You could fairly confidently say that "Apple" exists and "wjifdvq" does not, but given a plausible-looking name of a person or place that you don't recognize, you'd have a harder time. It's not a problem in practice though, because you can look it up.