Re:I asked GPT-3 to make a presentation for me
by skybrian on Monday July 20, 2020 @09:26PM
(#23903554)
Yes, it can memorize short phrases similar to how it "remembers" words. It's trained on a web corpus that includes and emphasizes Wikipedia. The model is big enough to memorize some things, though not in such a way that they can reliably be retrieved, and it will make stuff up when it doesn't remember. So it's not Google but sometimes it's reminiscent.
Here is a Q&A conversation where I found some things it "learned".
Here is a Q&A conversation where I found some things it "learned".
https://tildes.net/~games/qmc/ai_dungeon_dragon_model_upgrad...