News for hackers. Stuff that matters.
Re:Never trust a corporation to do a library’s job by ghaff on Sunday February 01, 2015 @09:50AM (#8980010)
I can't really disagree with the basic point. Expecting a for-profit organization--even if they're Google--to reliably over a long period of time provide an archiving service that's mostly a money [EDIT] leak isn't a realistic hope. The fact that it's embroiled Google in a number of ongoing legal disputes doesn't make it any easier.

On the other hand, it's not as if anyone (other than the Internet Archive of course) has exactly been stepping up to the plate. There's also the question of what a library is for these purposes and what do they have the right to do with respect to archiving copyrighted digital text and media.

Re:Never trust a corporation to do a library’s job by DanBC on Sunday February 01, 2015 @10:00AM (#8980035)
Deja News used to archive Usenet. They got bought by Google. It's now not possible[1] to specify a date range when searching Google Groups.

They took it, they broke it, and now we can't use it properly.

[1] http://webapps.stackexchange.com/questions/73179/how-do-i-sp...

Re:Never trust a corporation to do a library’s job by Tomte on Sunday February 01, 2015 @11:12AM (#8980395)
That's the least of the problems.

At some point Google Groups got really inconsistent, where it didn't turn up many, many postings and threads when searching for them. For some time you could find them if you tried several of their country TLDs (google.de, google.com), they brought up different results.

A bit later even that didn't work anymore, Google Groups has spotty coverage, at best.

Then they hid their advanced search interface. If you knew the URL you could still use it. Then they removed it altogether.

Nowadays you have probably no way to specifically search for something ("author:", "group:", "mid:"), nothing is working satisfactorily anymore).

Re:Never trust a corporation to do a library’s job by ghaff on Sunday February 01, 2015 @10:26AM (#8980170)
That's sort of the point of the article, no? And it's not like Deja News was likely to stay functional in any case.

It's probably also worth pointing out that before Deja News and Google were ever involved, a large chunk of Usenet came close to being lost [1] and significant chunks of it have been in any case. So it's not as if preservation necessarily happens in the absence of corporate involvement either.

[1] http://www.salon.com/2002/01/08/saving_usenet/

Re:Never trust a corporation to do a library’s job by mrottenkolber on Sunday February 01, 2015 @10:50AM (#8980271)
What I don't understand is why companies aren't held accountable for their obvious responsibilities. Google has to publicize these archives. It shouldn't be up to them if their public records are publicly accessible. I was born on this planet and I have the right to be able to get a copy of any Usenet archive Google has. For free. Whenever I want.

I really really hate them for locking up this data (like so much its not funny, like major humanitarian crime imho).

Re:Never trust a corporation to do a library’s job by Tomte on Sunday February 01, 2015 @11:08AM (#8980371)
I don't see how Google should have any responsibility wrt. Usenet.

Google is not the only party having Usenet archives. They are not even in any way special. They aren't the "official" archives, just as Deja wasn't.

If you're really interested in getting your hands on Usenet archives, going way back to the Ice Age, there are plenty of ways to do so.

Especially with the huge Hamster community (http://www.tglsoft.de/freeware_hamster.html), who are archiving almost fanatically, you should be able to get virtually everything you'd want just by asking nicely.

Other parties who certainly have archives are all the major news servers.

Re:Never trust a corporation to do a library’s job by Spooky23 on Sunday February 01, 2015 @02:43PM (#8981335)
The point isn't that they are required to be custodians of Usenet, it's that they volunteered to become a custodian, and then dropped the ball on that function in the most noxious way possible.

Tying it back to the article, you can't trust a company to do something in the public interest, or maintain that work in perpetuity unless you pay them.

Usenet is a limited example, a more impactful one would be Google locking down access to Maps, including all of the metadata contributed by the public. There's nothing stopping them from doing that.

Re:Never trust a corporation to do a library’s job by hackuser on Sunday February 01, 2015 @11:39AM (#8980550)
> Especially with the huge Hamster community (http://www.tglsoft.de/freeware_hamster.html), who are archiving almost fanatically, you should be able to get virtually everything you'd want just by asking nicely.

What is the Hamster community? It sounds interesting. The link points to some software that could be used to help archive, but doesn't say much more (at least browsing around the Google translation of it).

Re:Never trust a corporation to do a library’s job by Tomte on Sunday February 01, 2015 @01:01PM (#8980908)
Hamster is a local news and mail server for Win32.

It's comparable to sn on Linux: it acts as a reader, not as a "real news server" (IHAVE/SENDME).

So people could use it with their regular Usenet account on a dialup PC.

And since it's scriptable (alas, in some own script language), people extended it in lots of ways.

Re:Never trust a corporation to do a library’s job by hackuser on Sunday February 01, 2015 @02:09PM (#8981200)
Thanks. How does "archiving almost fanatically" fit in with that? Or is this archiving culture just coincidental?
Re:Never trust a corporation to do a library’s job by Tomte on Sunday February 01, 2015 @02:50PM (#8981366)
Coincidental. I haven't kept my archives, even though at one point I had sucked postings for several nights (all of de.*, and the Big8, I think).

But others kept their "purple data" religiously.

Re:Never trust a corporation to do a library’s job by mrottenkolber on Sunday February 01, 2015 @11:47AM (#8980590)
A simple torrent per decade would be nice.
Re:Never trust a corporation to do a library’s job by tormeh on Sunday February 01, 2015 @11:20AM (#8980441)
You really need to put a /s at the end of your sarcastic posts. HN commenters take things literally, as a rule.
Re:Never trust a corporation to do a library’s job by fpgeek on Sunday February 01, 2015 @11:19AM (#8980431)
I really hope this comment was intended sarcastically. It disturbs me that I can't tell. It disturbs me even more that other commenters believe it wasn't.
Re:Never trust a corporation to do a library’s job by krapp on Sunday February 01, 2015 @11:23AM (#8980453)
To be fair... on HN it is really difficult to tell sometimes.
Re:Never trust a corporation to do a library’s job by fpgeek on Sunday February 01, 2015 @11:12AM (#8980394)
Kinda skipping over the part where they grabbed it at death's door, aren't you?

Suppose Google had done nothing. The alternative wouldn't have been a beautifully indexed, easily searchable completely up-to-date Deja News archive today. It would have been that archive rotting in a landfill or that equipment being wiped and reused.

Has Google's stewardship of the Deja News archive been disappointing at times? Of course. But the idea that Google has taken anything away from you or anyone else reflects an amazing sense of entitlement and an astonishing lack of perspective.

Re:Never trust a corporation to do a library’s job by xorcist on Sunday February 01, 2015 @12:10PM (#8980689)
That's just making things up. Deja News could have ended up anywhere, including at the Internet Archive. The people running it sold it to Google in the belief it would be kept running. Had they not done it someone else would have.

The talk about entitlement completely misses that Google bought it only to prompty run it into the ground. If you do that in a market leading position to your competitors that's downright illegal in most jurisdictions.

That may not be applicable here, but you should be able to understand why this upset a lot of people.

Re:Never trust a corporation to do a library’s job by fpgeek on Sunday February 01, 2015 @01:58PM (#8981155)
> Deja News could have ended up anywhere, including at the Internet Archive.

This is exactly what I'm talking about. The idea that a company that is falling apart and selling itself off in pieces was going to donate one of its last major assets to charity... I don't even know where to start.

That was the whole problem. Running the archive wasn't a business (at least deja.com never figured out how to make it one and eventually gave up trying), but the archive ended up in the hands of investors and/or creditors that didn't care about that. You may be partially right - if Google hadn't bought them someone else might have (maybe Yahoo, AOL, Microsoft, or ...). I'm not sure about that (which is why the Google deal was good news at the time), but let's suppose you're right. All that would mean is that you would have ended up complaining about how some other buyer ran it into the ground. If you're going to make the case that Google got in the way of the Deja News archive's happy ending, you need a lot more than that.

Re:Never trust a corporation to do a library’s job by barkingcat on Sunday February 01, 2015 @11:04AM (#8980347)
When European style central libraries were first established, they were actually legally mandated copyright holding libraries, as in they were an arm of the government that was entitled to copies of any work published, regardless of authorship and licensing. The library had a perpetual legal "copyright" codified in law to any works produced by any author, and had the legal power to acquire, buy, and make copies themselves of any works that needed to be archived. They were authorized scribing/photocopying centers so to speak. Modern day libraries have shed much of their powers, but those powers are why we have access to historical texts in libraries today (instead of them being destroyed and lost in history).

In light of archivalship being a money loosing proposition for private corporations, it seems that we have the need for an internet/online library to have the right to copy/hold the entire internet in perpetuity for the use of future humankind - that's the mandate of the Internet Archive, and it would be great to see that codified in a UN resolution, for example.