News for hackers. Stuff that matters.
Re:Internet Archive as a default host-of-record for startups by jrwr on Tuesday December 21, 2021 @10:20PM (#29645249)
They do respect robots.txt matter of fact, it will remove the website outright and most of its archives will be hidden until that website's robots.txt is offline.

Their documentation about it is rather crap right now, but its in several of their FAQs about it

Re:Internet Archive as a default host-of-record for startups by pseudalopex on Sunday January 02, 2022 @08:32PM (#29776275)
Respecting robots.txt would mean not saving pages blocked by robots.txt. Not just hiding.