News for hackers. Stuff that matters.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by yters on Sunday July 19, 2020 @06:49PM (#23893093)
Exactly. Even gpt3 is not creating new content. It is just permuting ecisting content while retaining some level of coherence. I don't reason by repeating various tidbits I've read in books in random permutations. I reason by thinking abstractly and logically, with a creative insight here and there. Nothing at all like a Markov model trained on a massive corpus. Gpt3 may give the appearance of intelligent thought, but appearance is not reality.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by mietek on Sunday July 19, 2020 @09:12PM (#23893792)
> I don't reason by repeating various tidbits I've read in books in random permutations.

Are you sure?

Re:Tempering Expectations for GPT-3 and OpenAI’s API by yters on Monday July 20, 2020 @02:59PM (#23900805)
Yes, I would fail any sort of math exam if I used the GPT-3 model.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by CrazyStat on Sunday July 19, 2020 @07:11PM (#23893217)
GPT-3 is nothing like a Markov model.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by yters on Monday July 20, 2020 @02:59PM (#23900813)
Same sort of generative probabilistic model idea.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by catalogia on Sunday July 19, 2020 @11:40PM (#23894473)
All creative work is derivative.
Re:Tempering Expectations for GPT-3 and OpenAI’s API by yters on Tuesday July 21, 2020 @10:20PM (#23913306)
Not all derivative work is creative.