News for hackers. Stuff that matters.

A comment on Tempering Expectations for GPT-3 and OpenAI’s API. Parent comment

Re:Tempering Expectations for GPT-3 and OpenAI’s API by dragonwriter on Monday July 20, 2020 @12:55AM (#23894756)
> The fact that it can produce working code from a prompt in some cases shows rudimentary non-trivial reasoning.

No, “in some cases” doesn't show reasoning. It is, arguably, weak evidence for reasoning that supports other explanations. With the right input corpus, a Markov chain generator will produce working code from a prompt “in some cases”, and I don't think any one has a weak enough definition of reasoning to admit Markov chains.

[ Parent | on HN ]
Re:Tempering Expectations for GPT-3 and OpenAI’s API by hackinthebochs on Monday July 20, 2020 @01:05AM (#23894799)
Of course we need to quantify "in some cases" for your argument to hold. Humans aren't perfect reasoners, for example. The examples I saw were impressive and were mostly correct, apart from some minor syntax errors or edge cases. This wasn't a Markov chain generator where the "interesting" responses where cherry picked from a pile of nonsense.
[ Parent | on HN ]