> Hiring librarians is not a scalable solution to fixing metadata.
I’m skeptical of this line of reasoning.
If we can’t hire librarians to label all those books, how did we ever get people to write, edit, bind, read, distribute, and finally scan them?
Re:Eric Schmidt: “It Is A War For Talent”
by patio11 on Tuesday November 16, 2010 @12:44AM
(#1909193)
There are two products in Google which matter to the bottom line: core search and AdSense. If you are not one of these projects, anecdotally your requests to hire new people or get resources which cannot be requested by API get forwarded to Customer Service.
Re:Eric Schmidt: “It Is A War For Talent”
by waterlesscloud on Monday November 15, 2010 @11:16PM
(#1909011)
It's pretty obvious that Google just wants the raw data of the books for later projects, and the concept of making them available to the public as they have is nothing more than the thinnest of fig leaves. They're getting far, far more value from the libraries they're scanning than they are providing back to the world, and it's because of their atrocious metadata processes.
And if someone figures out how to automate the process, you'd be a fool to be "hired" by Google. That's something that should be paid for at a much higher rate than any salary.
Most people simply don't care about metadata. The average user searching for information doesn't use metadata fields to search, they just use free-form text search.
I understand the importance of good data for academics (bad metadata on electronic book archives drove me crazy when I was researching etymology for the OED), but for most people it doesn't really matter.
Google is a company which is about scale. Hiring librarians is not a scalable solution to fixing metadata. Figure out a way to automate that fixing and I'm willing to bet Google will offer to hire you.
edit: As it happens I actually looked at working on a fairly similar problem for my undergraduate thesis (automated dating of works of unknown provenance) so if someone wants to talk about ideas for how to fix it feel free to email me.