News for hackers. Stuff that matters.
Re:Papers on GitHub Copilot, copyright law, and ownership fo... by cycomanic on Saturday June 25, 2022 @08:47AM (#31874856)
I don't think anyone knows of the source data is encoded somehow in the model. Sure it is not explicitely, but it has been shown (at least for simpler models but also for copilot) that you can with the right prompts get them to output exact copies of results (even with possible typos in comments). That to me means the models do in fact somehow contain the source.

On the topic of derivative, backpropagation the method of training a model relies specifically on calculating the gradients or derivatives of your data.

Re:Papers on GitHub Copilot, copyright law, and ownership fo... by visarga on Saturday June 25, 2022 @02:03PM (#31877332)
But those gradients get averaged out, they don't stay separate for each input example.
Re:Papers on GitHub Copilot, copyright law, and ownership fo... by cycomanic on Saturday June 25, 2022 @04:31PM (#31878484)
So by averaging you remove it being derivative work?