News for hackers. Stuff that matters.
Re:Monolith – CLI tool for saving complete web pages as a si... by samstave on Sunday March 24, 2024 @08:42PM (#39811879)
(They missed a chance to have a link to a download of the mtnl file of the github page haha)

Archive.org and wayback machine should ask for people to submit snaps of pages using this tool directly into the archive - especially during world events.

This would allow digtal archeologists to grok the sentiment of the world during that era...

(aside: when I interviewed at twitter they asked me what I thought twitter was, and I said I thought it was a global sentiment engine...)

But kudos to the world for having us now in the AI birth onto the global internet, as a wayback machine, coupled with AIs and LLMs and this tool - will allow one to ask questions about history in ways that will be very interesting.

--

"What was the general media coverage of [topic] in [decade] with respect to how we currently look at it - and are they articles covering [SUBJECT] in this topic for that time period.

etc...

Re:Monolith – CLI tool for saving complete web pages as a si... by toomuchtodo on Sunday March 24, 2024 @09:49PM (#39812226)
https://github.com/palewire/savepagenow

https://github.com/jjjake/internetarchive

The Internet Archive cannot trust arbitrary content previously archived, so it is more optimal to have whatever archival tools or operations you’re performing to make a request to Wayback to take a snapshot at the same time.

If you’re bookmarking something, archive it too!

Re:Monolith – CLI tool for saving complete web pages as a si... by samstave on Monday March 25, 2024 @12:01AM (#39812769)
Yes, that a better version of what I meant...