But they are making unauthorized copies: Their training data set is analogous to private collection of duplicates.

What do you think copyright law(suits) would do if a regular person made copies of every book and movie and song they saw, placing the duplicate media in a room of their house?