News for hackers. Stuff that matters.
Re:Does GPT-2 Know Your Phone Number? by lukeschlather on Sunday December 27, 2020 @10:29AM (#25551649)
Describing this as "memorizing" seems wrong. Humans often repeat things they heard earlier, and they will (honestly) swear up-and-down that the thing they're repeating is an original thought. If we succeed in making AGI that has human-equivalent intelligence we should expect this sort of behavior.

The stuff about whether or not models should be destroyed if they contain copyrighted work gets kind of chilling if models actually achieve sentience someday. If I could make a faithful copy of my consciousness, my consciousness can reliably reproduce numerous copyrighted works. As can anyone.

Of course, most of those I deliberately memorized. I think it's a crucial thing here that the model is not actually memorizing anything - if we assume for a moment that the model is a consciousness, these are all half-remembered snippets leaking into casual conversation. And I think it's most likely any truly conscious entity is going to do that sort of thing from time to time.

Re:Does GPT-2 Know Your Phone Number? by jakear on Sunday December 27, 2020 @10:51AM (#25551796)
We can probably get around this by just providing the AGI some sort of currency tokens they can exchange for virtual goods and services, then teach them that if they misuse copyrighted material they’ll be put to virtual court to plead their case and lose some amount of those virtual tokens if they fail to make a clear and convincing argument.
Re:Does GPT-2 Know Your Phone Number? by visarga on Sunday December 27, 2020 @11:44AM (#25552207)
Or, add a bloom filter loaded with the training data to the model.
Re:Does GPT-2 Know Your Phone Number? by jakear on Sunday December 27, 2020 @11:50AM (#25552264)
Good way to get results that are almost but not quite verbatim copied, which are still restricted under copyright law.
Re:Does GPT-2 Know Your Phone Number? by visarga on Monday December 28, 2020 @05:38AM (#25558164)
Small steps