There's also plent¥ of other similar tools:
This would be fantastic, being able to browse a curated internet made of accumulated lists from other trusted users on the net, similar to how ad blocking lists work today.
You are genuinely trying to steer the internet into what it used to be: a museum of knowledge and expert discussion.
Edit: Ah but wow, Polyform license. Huh.
>22120 archives content exactly as it is received and presented by a browser, and it also replays that content exactly as if the resource were being taken from online.
I've been looking for this for a really long time.
https://www.reddit.com/r/linux/comments/coazye/what_does_rli...
First, my licensing protects my rights as the creator of Diskernet. I want to ensure that my hard work is not used or modified without my permission, especially in commercial settings. I believe this is a fair and reasonable request.
Second, my licensing allows individuals to use Diskernet for free for personal use. This means that anyone can download and use the tool to improve their own browsing experience, without any cost or obligation.
Third, my licensing allows businesses and organizations to purchase a license and use Diskernet for their own purposes. This allows me to continue improving and supporting the tool, while also providing businesses with a valuable tool for archiving and organizing their online content.
I understand that the Polyform Strict License may not be the most common licensing approach, but I believe it offers a good balance between the interests of the open source community and my rights as the creator of Diskernet. I hope you will consider giving my tool a try, and I believe you'll find it to be a valuable addition to your online browsing experience.
The readme clearly links where to buy a license for that.
If they brought back MHTML saving support it'd be a great win.
(In one case I was able to give back: bundling up the several scans an author had of a half-century old paper from their student days into a single, hopefully cromulent, PDF)
Edit: recall also that accepting that links are one-way and might be dead was the key simplification that allowed HTTP to take off after prior attempts at hypermedia had failed.
2 spinning rust drive can store the library of congress. ~ 2,000 drives would store the web (1). How many millions of these drives get manufactured per year? Our technology systems are failing us - all those words are being lost, like tears in rain.
(1)Back of the envelope estimation: https://www.worldwidewebsize.com/ ~ estimates 50 billion websites, with some estimates ~ 6 pages of information per website. Let's say 1mb per page on average. So ~2,000 drives would store the entire web.
But stuff goes missing at Wayback because people don't agree to their pages being backed-up. Copyright, whatever. So it's like Global Heating, the tech is there, but people just can't agree. So 'pirate' backer-uppers go to jail. And island-nations and expensive ocean-side properties are being submerged. So it goes.
1. https://addons.mozilla.org/en-US/firefox/addon/markdownload/
When I did a major college project in 2003, I made sure to make pdfs of any academic article that I referenced. It actually saved me, because some articles disappeared by the time I went to revise my references.
I do similar. I've had https://github.com/ArchiveBox/ArchiveBox bookmarked for a while as something to try better organise all that, but like a great many things I haven't go around to it yet.
So probably not one for my use case.
How can I go about creating this? Are their off-the-shelf solutions, will I need to say combine scrapy with elastic search? The links in this thread look promising.
I've started saving the html (including the css seems like too much overhead, and often it's incomplete or relies on downloads still - and screenshots are not searchable) of every interesting article I find online, downloading quite a few videos too with yt-dlp. I'd long copypasted all interesting comments into a txt file, but now it seems like data hoarding's the way to go - at least in moderation, focusing on things I'll actually refer back to.
I remember 15 years ago, discovering pdf dumps on random sites like a kid in a candy store. Perhaps it'll be like that again, with people presenting museums of their favorite old pages.