Re:Don't encode POST bodies like GitHub Copilot, use URLSear...
by IncRnd on Thursday July 01, 2021 @08:56AM
(#27698617)
> - The exact StackOverflow snippet said junior is copying was seen by others and likely already debugged to some extent. There's typically also a lot of relevant information in the text surrounding the snippet.
Empirically, this is false. There is an incredibly high amount of bad, incomplete, or vulnerable code on SO.
- The snippet you get from Copilot is generated by an DNN model. I'd think that alone should scare people. DNN models are correct on a continuous scale, not discrete. A bad pixel on a generated image, an extra comma in generated text, are considered OK. That kind of correctness framework doesn't work with code.
From what I read, Codex (the model powering Copilot) is a GPT-3 derivative. Surely you've played with GPT-3 before, you've seen the types of mistakes it makes. In my eyes, this approach just won't fly for code.