Why isn't the internet more fun and weird? (2019)

Re:Why isn't the internet more fun and weird? (2019) by marginalia_nu on Wednesday July 06, 2022 @10:53AM (#32001892)

Anecdotally, my own search engine index starts to feel stale after about two months. I wonder what the half-life of a link is.

[ Parent | on HN ]

Re:Why isn't the internet more fun and weird? (2019) by falcolas on Wednesday July 06, 2022 @11:50AM (#32002733)

I'm highly tempted to run a "caching" proxy 24x7 just to keep archives of some of these decaying gems around past their lifespan on the web.

I'd say I could just use archive.org (or similar), but their (admittedly necessary) respect of robots.txt makes their archive incomplete.

[ Parent | on HN ]

Re:Why isn't the internet more fun and weird? (2019) by quest88 on Wednesday July 06, 2022 @12:41PM (#32003456)

I've considered running my own IA (https://github.com/internetarchive/heritrix3), which only archives my chrome history, which is stored in a local sqlite db.

I haven't had the time to figure out the details of how the pieces should be glued together.

[ Parent | on HN ]

Re:Why isn't the internet more fun and weird? (2019) by causi on Wednesday July 06, 2022 @12:09PM (#32002984)

I also wish for a modern local archiving solution. HTTRACK just doesn't cut it anymore, unless you really want a local copy of a webcomic that stopped updating in 2003.

[ Parent | on HN ]

Re:Why isn't the internet more fun and weird? (2019) by kordlessagain on Wednesday July 06, 2022 @12:28PM (#32003286)

I use screenshots on my search engine to work around this issue. If you are interested, I have an open server deployment for it.

[ Parent | on HN ]