Re:Are language models deprived of electric sleep?
by Veedrac on Sunday July 24, 2022 @04:01AM
(#32211351)
> Besides, if your corpus is asymptomatically everything, why wouldn’t fitting it perfectly fitting it be the goal?
That's called Google, and it serves a different purpose. Perfectly learning the distributional properties of text instead is not overfitting, that's just fitting.
That's called Google, and it serves a different purpose. Perfectly learning the distributional properties of text instead is not overfitting, that's just fitting.