I didn't mean to say that the library of congress was indiscriminate, just that it likely also contains material that you disagree with. And that that doesn't really matter, because it's not the purpose of the repository to contain only non-controversial material.

Without an example, I can't agree with you, and no - the point is that the library of congress is curated content, the internet is not.

Old books from the 1800s with very outdated views on race, sex, etc would be an obvious example.

Edit: and why is curation relevant to the question of whether there should be a common crawl that can be accessed by all, a publicly hosted mirror of the web that can be used to create competing search engines?

I really don't care about old books from the 1800s.