Re:Tempering Expectations for GPT-3 and OpenAI’s API
by yters on Sunday July 19, 2020 @06:49PM
(#23893093)
Exactly. Even gpt3 is not creating new content. It is just permuting ecisting content while retaining some level of coherence. I don't reason by repeating various tidbits I've read in books in random permutations. I reason by thinking abstractly and logically, with a creative insight here and there. Nothing at all like a Markov model trained on a massive corpus. Gpt3 may give the appearance of intelligent thought, but appearance is not reality.
[ Parent
| on HN ]
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by mietek on Sunday July 19, 2020 @09:12PM
(#23893792)
> I don't reason by repeating various tidbits I've read in books in random permutations.
Are you sure?
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by yters on Monday July 20, 2020 @02:59PM
(#23900805)
Yes, I would fail any sort of math exam if I used the GPT-3 model.
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by CrazyStat on Sunday July 19, 2020 @07:11PM
(#23893217)
GPT-3 is nothing like a Markov model.
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by yters on Monday July 20, 2020 @02:59PM
(#23900813)
Same sort of generative probabilistic model idea.