An embarrassingly simple approach to recover unlearned knowledge for LLMs

Re:An embarrassingly simple approach to recover unlearned kn... by edude03 on Monday November 04, 2024 @10:09AM (#42042215)

Yes although how close to verbatim is debatable. For example there are questions that you’d ask that other people have asked many times before that you’d like the exact answer for (e.g. when does daylight saving time end?)

[ Parent | on HN ]

Re:An embarrassingly simple approach to recover unlearned kn... by startupsfail on Monday November 04, 2024 @11:50AM (#42043400)

> that make it forget specific facts. These are often meant to satisfy copyright claims

Facts are not copyrightable.

To quote copyright.gov: “Copyright does not protect facts, ideas, systems, or methods of operation, although it may protect the way these things are expressed.”

[ Parent | on HN ]

Re:An embarrassingly simple approach to recover unlearned kn... by PittleyDunkin on Monday November 04, 2024 @01:14PM (#42044407)

What is a fact without expression? It's not clear under what interpretation might be necessary to get the quoted sentiment to be considered sensical.

[ Parent | on HN ]

Re:An embarrassingly simple approach to recover unlearned kn... by seanmcdirmid on Monday November 04, 2024 @12:34PM (#42043938)

Wouldn't that be stuffed in the prompt anyways? No reason for the LLM to learn that.

[ Parent | on HN ]