Re:Copilot regurgitating Quake code, including sweary comments
by derefr on Friday July 02, 2021 @03:17PM
(#27715642)
I believe the concept is to stop users from prompting the AI to generate offensive stuff specifically, and then publishing the so-generated stream of offensive stuff as negative PR for GitHub, in the same way the generated stream of offensive stuff coming from Microsoft’s AI was a big PR disaster.
[ Parent
| on HN ]
Re:Copilot regurgitating Quake code, including sweary comments
by stingraycharles on Friday July 02, 2021 @06:26PM
(#27717691)
I suppose you’re referring to the AI Twitter bot that initially was very lovely and within a day 4chan had turned into a nazi. That was both very naive and hilarious.
https://spectrum.ieee.org/tech-talk/artificial-intelligence/...
The big difference in this case, however, is that this AI was constantly learning based on user input, however, which I do not think is the case for Copilot.
Re:Copilot regurgitating Quake code, including sweary comments
by drusepth on Friday July 02, 2021 @09:48PM
(#27718696)
Copilot is indeed constantly learning based on user input (as detailed here [1]) but it seems to be more high-level ("did the user accept or deny suggestion XYZ" and potentially what changes you make to suggestions after accepting) versus just dumping everything directly back into the model a la Tay.
[1] https://docs.github.com/en/github/copilot/about-github-copil...