News for hackers. Stuff that matters.
Re:Does GPT-2 Know Your Phone Number? by grenoire on Sunday December 27, 2020 @09:11AM (#25551135)
Very rough outcome:

"Moreover, if such a request were granted, must the model be retrained from scratch? The fact that models can memorize and misuse an individual’s personal information certainly makes the case for data deletion and retraining more compelling."

Besides, how would one even know that their info was used in a training dataset, only if and when it's revealed in a generated excerpt?

Re:Does GPT-2 Know Your Phone Number? by visarga on Sunday December 27, 2020 @11:42AM (#25552176)
They can try to prompt it. But I hope the GPT-3 authors have a hash list of ngrams in the training data to be able to avoid verbatim reproduction. I know they trained an offensive content detector model, they should also train a PII information detector to make sure it's being hashed.