> If we sit idly and allow for ingesting all what’s written for instance

It's already happened. What do you do now? For decades, it's happened regardless of the robots.txt so you have to assume it's all been ingested by it all, everywhere. What now?