i think this should be dismissed as it is the same level of transience as the workings of the internet; you and your ISP, caching proxies etc, all made a transient copy as part of the existing (legal) consumption of the works that the author has put online.
Unless the works was illegally copied for training - which cannot be true if the works was publicly available for viewing on the internet, this transient copying cannot be a valid infringement.
Downloading a singe transient copy of some image once in the lifetime of a company is different than doing that same action a hundred times once for each version of the network.
Hard to argue keeping a copy of some copyrighted work indefinitely counts as transient.
Precisely to argue for transient copies, they don't need to keep terabytes of data stored.
>Hard to argue keeping a copy of some copyrighted work indefinitely counts as transient.
You're assuming that they're keeping the works indefinitely, which again is not the case.
Those kinds of legal workarounds rarely work.
They are dependent persistent access allowing them the equivalent benefit of keeping a persistent copy.
Defendants can easily argue that being 1/10 millionth or whatever of the training set means their specific work is unlikely to show up in any specific example but the underlying mechanism means it can be recreated.
In the two US cases we have any progress on so far, the established requirement for substantial similarity (opposed to "dependant on" or such) has been upheld, with Judge Vince Chhabria specifically setting out that it'd "have to mean that if you put the Llama language model next to Sarah Silverman's book, you would say they're similar". and Judge William H. Orrick agreeing with the defendants that "plaintiffs cannot plausibly allege the Output Images are substantially similar or re-present protected aspects of copyrighted Training Images, especially in light of plaintiffs’ admission that Output Images are unlikely to look like the Training Images".
The UK definition of derivative works is, to my understanding, narrower and specifically enumerated as opposed to the US's more open-ended definition.
The remaining area of doubt, assuming the above remains consistent, is over the transient copying that occurs during training.