News for hackers. Stuff that matters.
Re:Activists rally to save Internet Archive as lawsuit threa... by jakeogh on Thursday June 11, 2020 @03:33AM (#23486135)
archive.org is a primary target for the book burners. As with any big thorn; they dont need coordination to attack it; it's practically a law of nature.

https://news.ycombinator.com/item?id=20623177

Archive team: is there a 101 on getting pages? I struggle to archive the things I want because of the JS interface and the generated data. I just want the links to the original GET 's and source files.

Torrents for the lowest level data per domain would be excellent. I would donate (again) to get priority for the ones I am interested in.

https://archive.org/donate

Re:Activists rally to save Internet Archive as lawsuit threa... by dingdingdang on Thursday June 11, 2020 @05:13AM (#23486733)
"I struggle to archive the things I want because of the JS interface and the generated data. "

Similar experience here, the interface and, worse, the lack of built-in p2p redundancy, even on the gross level, is quite staggering considering that the Archive org has modelled itself around the protection and archival of brittle information.

Really hope the lawsuit swings in their favour but damn there's work to do for them. When they last held a fundraiser because their traffic overwhelmed their servers I had a look at their basic search front page - it came in at a staggering 7-8mb per pageload as compared to under 100kb for most regular search engines?! This frankly makes me unlikely to donate since it seems so mismanaged that one -cannot- throw enough money at that for it to work at scale.

Re:Activists rally to save Internet Archive as lawsuit threa... by DelightOne on Thursday June 11, 2020 @09:39AM (#23488726)
Is there a different way than downloading the displayed page from the wayback machine again? It seems to support raw html download but I haven't found a way to get the accompanying JS/CSS easily.

I saw some API to manage ones' own collections but that seems to be only for owners...

Re:Activists rally to save Internet Archive as lawsuit threa... by zucker42 on Thursday June 11, 2020 @12:27PM (#23490493)
Re:Activists rally to save Internet Archive as lawsuit threa... by aspenmayer on Thursday June 11, 2020 @10:10AM (#23489053)
I’d ask on email or IRC. Info is probably on their site but I couldn’t find it yet.

https://www.archiveteam.org/