News for hackers. Stuff that matters.

A comment on GitHub Copilot Generated Insecure Code in 40% of Circumstances During Experiment. Parent comment

Re:GitHub Copilot Generated Insecure Code in 40% of Circumst... by iainmerrick on Friday September 03, 2021 @07:26AM (#28402764)
It seems reasonable to want Copilot to help you produce code of a reasonable quality.

If it’s just helping you crank out the same bad code more quickly, without learning anything in the process, that’s useful to know. Some people might still want a tool like that, I wouldn’t.

[ Parent | on HN ]
Re:GitHub Copilot Generated Insecure Code in 40% of Circumst... by burnished on Friday September 03, 2021 @09:17AM (#28403768)
Sure. But in order to know if its 'of reasonable quality' you need some sort of baseline to compare it to. What is reasonable quality? I think what your average human does is probably reasonable.

Like, if your average dev will produce insecure code in 80% of samples, then Copilot starts to look really good! But if its closer to 0.01% of code samples, then copilot looks more like an intriguing novelty, not to be brought too near serious work. Much like dippin dots in this regard.

[ Parent | on HN ]