News for hackers. Stuff that matters.
Re:Eric Schmidt: “It Is A War For Talent” by mikecane on Monday November 15, 2010 @07:16PM (#1908500)
What kind of "talent"? The egregious metadata of Google Books has been brought up in book circles again and again. Fixing that should not require the kind of hiring hoops that programmers go through. Librarian and other specialist degrees existed long before there was ever a Google. Some things Google just doesn't want to be bothered with. (And when it comes to books, ditto for Apple.) [typo edit]
Re:Eric Schmidt: “It Is A War For Talent” by ig1 on Monday November 15, 2010 @07:57PM (#1908615)
There's no significant return to google for fixing the metadata. It's not that google can't do it, it's that they don't want to do it.

Google is a company which is about scale. Hiring librarians is not a scalable solution to fixing metadata. Figure out a way to automate that fixing and I'm willing to bet Google will offer to hire you.

edit: As it happens I actually looked at working on a fairly similar problem for my undergraduate thesis (automated dating of works of unknown provenance) so if someone wants to talk about ideas for how to fix it feel free to email me.

Re:Eric Schmidt: “It Is A War For Talent” by alanh on Monday November 15, 2010 @10:45PM (#1908947)
> Hiring librarians is not a scalable solution to fixing metadata.

I’m skeptical of this line of reasoning.

If we can’t hire librarians to label all those books, how did we ever get people to write, edit, bind, read, distribute, and finally scan them?

Re:Eric Schmidt: “It Is A War For Talent” by patio11 on Tuesday November 16, 2010 @12:44AM (#1909193)
There are two products in Google which matter to the bottom line: core search and AdSense. If you are not one of these projects, anecdotally your requests to hire new people or get resources which cannot be requested by API get forwarded to Customer Service.
Re:Eric Schmidt: “It Is A War For Talent” by waterlesscloud on Monday November 15, 2010 @11:16PM (#1909011)
It's pretty obvious that Google just wants the raw data of the books for later projects, and the concept of making them available to the public as they have is nothing more than the thinnest of fig leaves. They're getting far, far more value from the libraries they're scanning than they are providing back to the world, and it's because of their atrocious metadata processes.

And if someone figures out how to automate the process, you'd be a fool to be "hired" by Google. That's something that should be paid for at a much higher rate than any salary.

Re:Eric Schmidt: “It Is A War For Talent” by ig1 on Tuesday November 16, 2010 @07:48AM (#1909891)
Most people simply don't care about metadata. The average user searching for information doesn't use metadata fields to search, they just use free-form text search.

I understand the importance of good data for academics (bad metadata on electronic book archives drove me crazy when I was researching etymology for the OED), but for most people it doesn't really matter.

Re:Eric Schmidt: “It Is A War For Talent” by mikecane on Tuesday November 16, 2010 @03:39PM (#1911551)
Thanks to all of you who replied. Interesting perspectives on things.
Re:Eric Schmidt: “It Is A War For Talent” by nl on Tuesday November 16, 2010 @09:54PM (#1912704)
Oh please!

The egregious metadata of Google Books is almost all date related problems. Anyone programmer who has done metadata-related work before will tell you that human compiled metadata always needs to be treated carefully, and date related metadata is usually "wrong" when the metadata comes from multiple sources.

Don't believe me? Crosswalk your data to dublin core and then tell me what date it was written, first published and the date the edition you have was published. I bet all those field go to dc.created and in standard dublin-core you have no way to identify which is which.

Now tell me why Google's data is so bad again?

The truth is that for subject-related data it is much, much better that library catalogs, for Author data it is pretty close and for date data the library catalog wins at the moment.

(Speaking as someone who spent a long time working in the field, and has had papers presented at the world library congress and at dublin core metadata conferences)