If every AI company pointed their scrapers to archive.org, that site would go down immediately as well.

This is just kicking the can down the road.

We have a major structural problem now. We want data to be free and machine readable, but no startup (and even a giant like Twitter) can afford the server cost to withstand all those machines.