News for hackers. Stuff that matters.
Re:The Disarray Inside Boeing's 737 Factory Before the Door ... by impish9208 on Tuesday April 02, 2024 @06:06AM (#39903993)
Sorry for the link, it seems like archive.is is no longer able to bypass the paywall for the WSJ.
Re:The Disarray Inside Boeing's 737 Factory Before the Door ... by top_sigrid on Tuesday April 02, 2024 @06:39AM (#39904209)
This one is working: https://archive.ph/WYdVW
Re:The Disarray Inside Boeing's 737 Factory Before the Door ... by impish9208 on Tuesday April 02, 2024 @06:41AM (#39904225)
Thanks!
Re:The Disarray Inside Boeing's 737 Factory Before the Door ... by thriftwy on Tuesday April 02, 2024 @06:13AM (#39904047)
I believe that archive.is is whatever you've archived into it. If you pressed the button when looking at the paywall, that's what it will carry.
Re:The Disarray Inside Boeing's 737 Factory Before the Door ... by mschuster91 on Tuesday April 02, 2024 @06:42AM (#39904236)
No, they run their own crawler against the URL you provide (IIRC, it's a headless Google Chrome [1]). For some special / often-requested (?) sites the people behind the project have:

- implemented post-processing to strip ads and tracker beacons

- bought legitimate accounts that they use to bypass paywalls (some of them show up as remnants in the archived pages' code, some of them show up when you request an archive of the site's account management portal, some show up as HTTP traces during the archival process - the crawler will dump every URL it requests on a "WIP" page, and for some, auth information like JWTs is passed in the URL)

- implemented anti-nagwall features (some sites are "vulnerable" in their paywall/"you read X articles, end of free limit" by pressing the ESC key to disrupt the JS of the site)

[1] https://blog.archive.today/post/618635148292964352/what-scra...