I feel like frontier models are stealing the entire internet and the entire whatever any human wrote in the latest centuries, including everything _I_, being an human on the internet, wrote. So I have a hard time being morally concerned about them being distilled.

That happened to individuals, so it is fine. This crime is happening against a company, that is wrong and bad.

Violent agreement here, especially if the ostensible difference is entirely dependent on reciting the correct legal incantation ( "fair use" vs "violates TOS")

100%! I want it all taken back and made open. Individual corps shouldn't own and control it all. They can cry me a river as the local models continue to get better.

Not like anthropic or open ai, they sure downloaded torrents of everything to train, crawl the web non stop, eat open source developers work, git repos etc, not pay ANY but they are not distilling other models at least....

Don't forget destructively scanning books too.

Tbf that's in the same realm as "data centers use all the water!" (they don't, like at all). Google were stripping book spines to scan books into Google Books long before modern AI was even a thing.

Sure if they're doing that to "one copy of 100" feel free to get mad. But one copy of millions of copies? I'm glad when books get digitised.

It is well known that anthropic stole from Qwen and Deepseek for their chinese language training.