News for hackers. Stuff that matters.
Re:Getty Just Made 4,600 Images Public Domain by nfriedly on Friday August 16, 2013 @05:12PM (#6226764)
Here's a link to the actual collection: http://search.getty.edu/gateway/search?q=&cat=highlight&f=%2...

Getty's blog post about it: http://blogs.getty.edu/iris/open-content-an-idea-whose-time-...

An example page where you can download a 4264px × 3282px copy of Van Gogh's 'Irises' (28mb .jpg): http://search.getty.edu/museum/records/musobject?objectid=94...

I'm wondering how long it will be before someone creates a .torrent with the entire collection...

Re:Getty Just Made 4,600 Images Public Domain by mryingster on Friday August 16, 2013 @05:33PM (#6226857)
I won't lie... I came here hoping for a link to the torrent of the entire collection...
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Friday August 16, 2013 @05:44PM (#6226895)
Already working on it (putting together a package for the Internet Archive; might as well put a torrent up as well).

EDIT: Scraper running. Should be done shortly (collecting small version, original version, XML data).

Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Friday August 16, 2013 @09:06PM (#6227772)
Update: Still scraping, lots of sleep X to be gentle on Getty.
Re:Getty Just Made 4,600 Images Public Domain by iooi on Saturday August 17, 2013 @02:13AM (#6228345)
Do you mind sharing what tool you use to scrape?
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @11:27AM (#6229325)
I was rushing, so it was just curl, lynx, sed, awk, all wrapped with bash. Don't judge; I'd use python and a scraping library if I wasn't rushing.
Re:Getty Just Made 4,600 Images Public Domain by fluxon on Saturday August 17, 2013 @01:20PM (#6229677)
Thank you for taking the initiative.
Re:Getty Just Made 4,600 Images Public Domain by dawie on Saturday August 17, 2013 @12:24AM (#6228150)
Please post the torrent link once it's done.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Sunday August 18, 2013 @03:45PM (#6233896)
Putting the torrent up now. It's ~100GB of content, so give it a bit.
Re:Getty Just Made 4,600 Images Public Domain by ericcoleman on Monday August 19, 2013 @12:05PM (#6237949)
Yay! Link yet?
Re:Getty Just Made 4,600 Images Public Domain by karasinski on Tuesday August 20, 2013 @12:12PM (#6244592)
Doesn't look like it! Will be excited to see this though.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @12:29PM (#6229499)
I will.
Re:Getty Just Made 4,600 Images Public Domain by pandesmos on Saturday August 24, 2013 @03:06AM (#6267967)
I'm not going to give up hope. I still believe.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Thursday September 05, 2013 @02:16PM (#6335837)
Was at Burning Man, this totally fell off my plate. I'm looking for someplace to put the 100GB zip file up right now.
Re:Getty Just Made 4,600 Images Public Domain by bravura on Sunday September 08, 2013 @02:45PM (#6349756)
Amazon S3, requester pays.
Re:Getty Just Made 4,600 Images Public Domain by zz1 on Friday September 13, 2013 @08:10AM (#6379908)
Internet Archive?
Re:Getty Just Made 4,600 Images Public Domain by rogerhoward on Friday August 16, 2013 @07:02PM (#6227303)
They had the S3 bucket originally set to allow listing - I grabbed it all before I reported it to an engineer there.

Not going to post a torrent though - mostly cuz you all can figure it out anyhow. The images are all of the form:

NNNNNN01.JPG on that S3 bucket.

NNNNNN is the object ID (the internal record ID of the work of art) zero-padded to 6 digits. The object ID is the same value that appears, for instance, in the URL on their online collection:

URL for Irises: http://www.getty.edu/art/gettyguide/artObjectDetails?artobj=...

URL for the full-rez image on S3: http://gettylargeimages.s3.amazonaws.com/00094701.jpg

You figure it out :)

Re:Getty Just Made 4,600 Images Public Domain by hobs on Friday August 16, 2013 @08:54PM (#6227736)
I dont understand... wouldnt offering a torrent be more friendly than us all downloading it again?
Re:Getty Just Made 4,600 Images Public Domain by 6cxs2hd6 on Saturday August 17, 2013 @09:35PM (#6231209)
Re:Getty Just Made 4,600 Images Public Domain by hobs on Tuesday August 20, 2013 @01:06PM (#6245016)
Thats pretty sweet actually, definitely +1.

I said my original comment because the idea was to have use learn the power of wget by redownloading all files, which seemed pointless to me.

Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @10:51PM (#6231417)
This is exactly how I plan to serve up the compiled archive.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @10:54PM (#6231425)
1) Iterate through all the search results pages (1-94) to get objectids.

2) Iterate through objectids to fetch the following: a) xml data b) thumbnails (from getty servers) c) original work on cloudfront

You're assuming the convention holds across all ~4600 objects. Never assume. Follow the links.

Re:Getty Just Made 4,600 Images Public Domain by uniclaude on Friday August 16, 2013 @08:19PM (#6227600)
Nice.

That would make a convenient fizzbuzz style interview question.

Re:Getty Just Made 4,600 Images Public Domain by rogerhoward on Friday August 16, 2013 @06:59PM (#6227277)
search.getty.edu is a Solr-based search index of resources across the Getty, including library catalogs and much beyond the Getty Museum's own collection - just FYI. You can filter for the collection, as well as for objects with images (and objects with open access images).

There's also the more focused, but less functional, Getty Museum online collection, which has (more or less) the same museum objects, and also has links to download the images where available.

Note, this is ~5000 images out of a collection of hundreds of thousands of objects. This is the easy stuff - public domain objects, with no rights/contract issues, with available, high-quality imaging, fully owned by Getty.