News for hackers. Stuff that matters.
Re:AI weights are not open “source” by version_five on Wednesday July 05, 2023 @06:04PM (#36607826)
I agree with you but I think it's important to have some nuance. Imagine I build a statistical model for 10-word sequences (10-grams) and then I trained it on a single book. I probably could pick some starting words and get most of the book back from the "statistics" I compiled. If I trained the same model on a giant dataset, the one book would just contribute to the stats.

All that to say, the models have potential to memorize, but they don't, and if they do it's an undesirable failure mode, not some deliberate copying.

There are no comments on this comment yet.