Re:ArchiveBox: Open-source self-hosted web archiving
by Dylan16807 on Thursday January 11, 2024 @06:36PM
(#38961181)
Are you assuming "people in power" were tied to those situations, though? Specifically, did you check if they were following a robots.txt? I have some criticisms for how they handle robots.txt, but if that's the root cause then it paints a very different picture.
[ Parent
| on HN ]
Re:ArchiveBox: Open-source self-hosted web archiving
by kornhole on Thursday January 11, 2024 @07:33PM
(#38961804)
I recall trying to archive a story on a Des Moines local news site. It was publicly available and searchable. I understand people can request of IA not to allow their content to be stored, and there are situations where content is removed on request. Beyond that, it is all opaque to me what goes on there.