News for hackers. Stuff that matters.
Re:Your own movie database in 5 minutes with IMDb API and Perl by danso on Monday November 21, 2011 @03:39PM (#3262712)
The terms and conditions seem pretty clear that you can't save site content except for page caching: http://www.imdb.com/help/show_article?conditions

>IMDb grants you a limited license to access and make personal use of this site and not to download (other than page caching) or modify it, or any portion of it, except with express written consent of IMDb. This site or any portion of this site may not be reproduced, duplicated, copied, sold, resold, visited, or otherwise exploited for any commercial purpose without express written consent of IMDb. This license does not include any resale or commercial use of this site or its contents or any derivative use of this site or its contents.

(and no, I'm not trying to be a negative nancy. I've wanted to analyze imdb for awhile but have known that it's not possible to do so without breaking TOC)

Re:Your own movie database in 5 minutes with IMDb API and Perl by AdamTReineke on Monday November 21, 2011 @04:50PM (#3262965)
There is some data available for personal, non-commercial use. http://www.imdb.com/help/show_leaf?usedatasoftware

However, licensing the database is super expensive: "We offer licensing packages that start at US$15,000 per year." http://www.imdb.com/help/licensing/contact

Re:Your own movie database in 5 minutes with IMDb API and Perl by Jun8 on Monday November 21, 2011 @05:08PM (#3263019)
Right, which brings us to the question: who actually owns the data, i.e. where did IMDb get its data? Is a movie's crew public information? Will the studios give this information to me if I ask them?

I think it would be interesting an very useful to have a db of information of all Hollywood movies (my guess ~50-60K) and make it freely available.

Re:Your own movie database in 5 minutes with IMDb API and Perl by sp332 on Monday November 21, 2011 @05:11PM (#3263029)
It doesn't matter who owns the information. If you break the Terms of Service, you don't get to use their service to access the information.
Re:Your own movie database in 5 minutes with IMDb API and Perl by Jun8 on Monday November 21, 2011 @05:20PM (#3263070)
I think it matters a lot if your intention goes beyond playing with the data into using it commercially. The question is: Can I download the IMDb data (by any means necessary) and use it for my startup. To me their License rules this out.

My question was: if the data is public, can IMDb enforce this hold on it. Probably not, as there's precedent of courts not siding with Museums who tried to shut off access images to the objects they hold, citing the effort required to take photos, etc.

Re:Your own movie database in 5 minutes with IMDb API and Perl by sp332 on Monday November 21, 2011 @05:27PM (#3263104)
Well, facts are generally not copyrightable. But the specific representation of the data on the IMDB website or through the API probably is copyrightable. So making an unauthorized copy might be illegal, and redistributing that raw data is definitely a violation of copyright.

But if you get the data from IMDB, and "substantially transform" the actual representation into something else, they can't claim an infringement just because you copied their facts.

But then again, if you break the ToS, they might get you on "unauthorized access of a computer system" with commercial intent, so huge fines etc. even if there is no copyright violation.

Re:Your own movie database in 5 minutes with IMDb API and Perl by hvs on Monday November 21, 2011 @05:14PM (#3263043)
Who would be paying for this DB to be hosted? It's always interesting to talk about making things "free", but in the end someone is paying for it.
Re:Your own movie database in 5 minutes with IMDb API and Perl by Jun8 on Monday November 21, 2011 @05:35PM (#3263139)
Well, we're not talking of GB of data here, or are we? Let me, see: I think about 1K movies are produced every year, halve that and multiply by 100, you get about 50K movies total. Let's double that to account for shorts, independents, etc. and we get 100K movies in the db. How much info is for one movie? The crew of Titanic from IMDb as text is around 85K. Let's say less than 256K per movie. So we're looking at about 13GB of data. With lossless compression, e.g. LZW and some austerity, say ~5GB.

That's not tiny, but not huge. And the amount of download bandwidth will not be much, due to long-tail effects. A company like Google or Amazon, who stand to benefit a lot from such a db can easily accommodate this.

Re:Your own movie database in 5 minutes with IMDb API and Perl by corin_ on Monday November 21, 2011 @06:20PM (#3263278)
Amazon already have a database like that, called imdb. ;)
Re:Your own movie database in 5 minutes with IMDb API and Perl by Jun8 on Monday November 21, 2011 @10:08PM (#3263883)
Yeah, I meant one that wouldn't charge ~$15K for commercial access. One that would charge per db access would be nice.

But it's not exactly the money (after all fifteen grand, although excessive is not prohibitive) but the unreliability factor: if you're building a business on a db API there should be a warranty that the company won't decide to abandon it or cut your access unreasonably.

Re:Your own movie database in 5 minutes with IMDb API and Perl by corin_ on Tuesday November 22, 2011 @02:59AM (#3264600)
My point was that, seeing as Amazon own imdb, they probably don't charge themselves ~$15k for access.
Re:Your own movie database in 5 minutes with IMDb API and Perl by dashr on Monday November 21, 2011 @03:42PM (#3262727)
anyone know of a good place to get Movie data (and possibly Cast/Crew) info for free or low cost for a commercial project?
Re:Your own movie database in 5 minutes with IMDb API and Perl by huskyr on Monday November 21, 2011 @05:13PM (#3263037)
Wikipedia has loads of movie data. You can use the API to extract it, or use dbpedia.org for a more friendly view.
Re:Your own movie database in 5 minutes with IMDb API and Perl by senthil_rajasek on Monday November 21, 2011 @03:47PM (#3262748)
freebase.com
Re:Your own movie database in 5 minutes with IMDb API and Perl by pyre on Monday November 21, 2011 @05:08PM (#3263020)
themoviedb
Re:Your own movie database in 5 minutes with IMDb API and Perl by phaylon on Monday November 21, 2011 @05:14PM (#3263044)
There's also a CPAN DIstribution for that: https://metacpan.org/release/TMDB