Re:Are language models deprived of electric sleep?
by benreesman on Saturday July 23, 2022 @02:15PM
(#32205958)
Oh sure. I didn’t mean to imply that GPT-6 will have memorized Wikipedia.
As you start to get to the size and comprehensiveness in the corpus that’s going on now, novel model outputs approach being something that might not have been in the training set, but likely will be in the future.
As you start to get to the size and comprehensiveness in the corpus that’s going on now, novel model outputs approach being something that might not have been in the training set, but likely will be in the future.