Re:Ask HN: What's the Legality Around Web Archival?
by otterley on Saturday September 28, 2019 @04:01PM
(#21102524)
Archive.org has a special exemption granted by the Library of Congress to break copyright protection for the purpose of making archives; and I believe it does so only when the copyright holder cannot be identified to ask for permission after a reasonable attempt has been made. It does not have a blank check to archive the entire Internet without permission -- if it did, you'd be able to read every New York Times article published since they went online there.
No, the Archive collects web pages that are publicly available. We do not archive pages that require a password to access, pages that are only accessible when a person types into and sends a form, or pages on secure servers. Pages may not be archived due to robots exclusions and some sites are excluded by direct site owner request."""
See https://help.archive.org/hc/en-us/articles/360004716091-Wayb...:
"""Do you collect all the sites on the Web?
No, the Archive collects web pages that are publicly available. We do not archive pages that require a password to access, pages that are only accessible when a person types into and sends a form, or pages on secure servers. Pages may not be archived due to robots exclusions and some sites are excluded by direct site owner request."""