News for hackers. Stuff that matters.

A comment on I Bought a Book About the Internet from 1994 and None of the Links Worked.

Re:I Bought a Book About the Internet from 1994 and None of ... by whatever_dude on Tuesday August 15, 2017 @12:27PM (#15019668)
I've had a similar problem. In updating my portfolio site recently, I noticed a vast majority of links were dead. Not just live projects published maybe 3 years or more ago (I expect those to die). But also links to articles and mentions from barely one year ago, or links to award sites, and the like. With a site listing projects going back ~15 years, one can imagine how bad things were.

I had to end up creating a link component that would automatically link to an archive.org version of the link on every URL if I marked as "dead". It was so prevalent it had to be automated like that.

Another reason why I've been contributing $100/year to the Internet Archive for the past 3 years and will continue to do so. They're doing some often unsung but important work.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by cheapsteak on Tuesday August 15, 2017 @02:40PM (#15021053)
For portfolios, you should really also look into https://webrecorder.io/

It's _not_ a video recording service. It saves and can replay all network requests during a session (including authenticated requests). It's open source, you can self host, I'm not affiliated even though I'm very happy that it exists

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by no_news_is on Wednesday August 16, 2017 @12:58AM (#15025040)
Thanks for mentioning this site. I've done this with mitmproxy but it's complicated, and this was super easy -- I could recommend to anyone.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by whatever_dude on Wednesday August 16, 2017 @08:01AM (#15026770)
That's impressive. I'll take a look, thanks for the tip.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by nfriedly on Tuesday August 15, 2017 @04:16PM (#15021966)
I've updated my portfolio before and noticed that as well. I usually include a screenshot or two when I first add a project, so at least that remains.

If the site goes down later, I just remove the link and don't worry about it. My code from 15 years ago is probably atrocious, so I'll consider it a small blessing :P

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by jedberg on Tuesday August 15, 2017 @02:09PM (#15020759)
I actually downloaded a copy of the NYT article I was quoted in in 1996 specifically because I feared it would fall off the internet at some point.

It's behind a paywall now, but at least I have a digital copy!

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by Asooka on Tuesday August 15, 2017 @02:12PM (#15020796)
Isn't that illegal, since you don't own the copyright? Or are you not distributing it and keeping it for archive purposes?
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by jedberg on Tuesday August 15, 2017 @02:18PM (#15020858)
It's on my website, which is a blatant copyright violation. So far the NYT hasn't asked me to take it down.

It could potentially be considered fair use, since I'm not making a profit and I provide commentary.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by exergy on Tuesday August 15, 2017 @04:30PM (#15022144)
> It's on my website, which is a blatant copyright violation

Tangential, but I long for a world where we can all be as candid with each other.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by daemin on Wednesday August 16, 2017 @05:22AM (#15026068)
I figure you're doing the same as someone that cuts an article that they are mentioned in out of a newspaper and frames it on their wall. I've seen plenty of restaurants and businesses do it.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by hellofunk on Wednesday August 16, 2017 @07:32AM (#15026640)
Except that's a physical product that was purchased.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by 91bananas on Wednesday August 16, 2017 @08:59AM (#15027074)
What if OP purchased a copy of that day's paper?
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by hellofunk on Wednesday August 16, 2017 @02:04PM (#15029661)
That's exactly the point I'm making.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by fao_ on Wednesday August 16, 2017 @09:07AM (#15027121)
Isn't the argument for adverts that they're somewhat equivalent to buying the website page?

And: Who has been harmed here?

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by ringaroundthetx on Tuesday August 15, 2017 @07:23PM (#15023654)
> It could potentially be considered fair use, since I'm not making a profit and I provide commentary.

Although people through that term around willy nilly, in our current framework that means being sued for a minimum of $100,000 per supposed violation, and making your fair use defense in front of a judge.

Youtubers have reported spending $50,000 just to begin talking with lawyers and preparing briefs.

Maybe our ISPs can start offering us insurance.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by DiabloD3 on Tuesday August 15, 2017 @08:56PM (#15024123)
If he is actually providing commentary and it does meet the fair use requirements, the EFF would probably end up representing him.

Remember to donate to the EFF, they're literally the only thing between you and a world where the corporations rule the world.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by simias on Tuesday August 15, 2017 @08:37PM (#15024047)
Don't downvote people for asking questions ffs!
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by LoSboccacc on Tuesday August 15, 2017 @01:44PM (#15020500)
beware: robots.txt can retroactively clear archive.org data
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by C4K3 on Tuesday August 15, 2017 @04:11PM (#15021912)
Hopefully not anymore: https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by viddi on Tuesday August 15, 2017 @06:25PM (#15023287)
To clear things up: robots.txt can retroactively hide content from the archive. If it's changed back to allowing the archive's crawler, content from before the ban can be accessed again.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by deadalus on Tuesday August 15, 2017 @02:00PM (#15020673)
another reason to use archive.is
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by pilsetnieks on Tuesday August 15, 2017 @08:50PM (#15024097)
Considering the topic of discussion, how sure can you be that archive.is will still be around in a year? Three years? Ten?

As much as I tried, all I could find about it is that it's run by one guy in Czech Republic who's paying $2000/month out of pocket for hosting, and apparently dislikes Finland.

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by exikyut on Tuesday August 15, 2017 @11:24PM (#15024731)
It's actually worse - http://blog.archive.is/post/151510917631/how-do-you-guys-kee... says it's $4k/mo.

http://archive.is/robots.txt doesn't seem too bad, it looks like you could slowly inhale everything... in theory. There are no sitemaps (they're there, but empty placeholders); you have to know the site name to be able to get a workable list.

The author hasn't ruled out/blocked archiving the snapshots, but apparently it's... big. http://blog.archive.is/post/154930531126/if-someone-was-will...

[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by cooper12 on Wednesday August 16, 2017 @04:07PM (#15030857)
I think http://www.webcitation.org/ might be better in that regard since it's a consortium of "editors, publishers, libraries". See "How can I be assured that archived material remains accessible and that webcitation.org doesn't disappear in the future?" in their FAQ (http://www.webcitation.org/faq). Although from my perspective it seems to be more geared towards academic use.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by msla on Tuesday August 15, 2017 @05:24PM (#15022756)
archive.is is very nice, but they're a URL-shortener as well, so their links are utterly opaque strings of alphanumerics, whereas the Wayback Machine preserves both the full original URL and the date and time it was captured in the archival URL.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by notyourwork on Tuesday August 15, 2017 @03:56PM (#15021758)
What is the difference between these two?
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by snerbles on Tuesday August 15, 2017 @05:21PM (#15022740)
archive.is does not crawl automatically, it must be pointed at a page by a user. While this makes it particularly useful for snapshotting frequently-changed pages, it is not a replacement for the proper Internet Archive.
[ Parent | on HN ]
Re:I Bought a Book About the Internet from 1994 and None of ... by dublinben on Tuesday August 15, 2017 @04:56PM (#15022446)
perma.cc is another option as well.
[ Parent | on HN ]