News for hackers. Stuff that matters.
Re:Getty Just Made 4,600 Images Public Domain by mryingster on Friday August 16, 2013 @05:33PM (#6226857)
I won't lie... I came here hoping for a link to the torrent of the entire collection...
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Friday August 16, 2013 @05:44PM (#6226895)
Already working on it (putting together a package for the Internet Archive; might as well put a torrent up as well).

EDIT: Scraper running. Should be done shortly (collecting small version, original version, XML data).

Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Friday August 16, 2013 @09:06PM (#6227772)
Update: Still scraping, lots of sleep X to be gentle on Getty.
Re:Getty Just Made 4,600 Images Public Domain by iooi on Saturday August 17, 2013 @02:13AM (#6228345)
Do you mind sharing what tool you use to scrape?
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @11:27AM (#6229325)
I was rushing, so it was just curl, lynx, sed, awk, all wrapped with bash. Don't judge; I'd use python and a scraping library if I wasn't rushing.
Re:Getty Just Made 4,600 Images Public Domain by fluxon on Saturday August 17, 2013 @01:20PM (#6229677)
Thank you for taking the initiative.
Re:Getty Just Made 4,600 Images Public Domain by dawie on Saturday August 17, 2013 @12:24AM (#6228150)
Please post the torrent link once it's done.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Sunday August 18, 2013 @03:45PM (#6233896)
Putting the torrent up now. It's ~100GB of content, so give it a bit.
Re:Getty Just Made 4,600 Images Public Domain by ericcoleman on Monday August 19, 2013 @12:05PM (#6237949)
Yay! Link yet?
Re:Getty Just Made 4,600 Images Public Domain by karasinski on Tuesday August 20, 2013 @12:12PM (#6244592)
Doesn't look like it! Will be excited to see this though.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @12:29PM (#6229499)
I will.
Re:Getty Just Made 4,600 Images Public Domain by pandesmos on Saturday August 24, 2013 @03:06AM (#6267967)
I'm not going to give up hope. I still believe.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Thursday September 05, 2013 @02:16PM (#6335837)
Was at Burning Man, this totally fell off my plate. I'm looking for someplace to put the 100GB zip file up right now.
Re:Getty Just Made 4,600 Images Public Domain by bravura on Sunday September 08, 2013 @02:45PM (#6349756)
Amazon S3, requester pays.
Re:Getty Just Made 4,600 Images Public Domain by zz1 on Friday September 13, 2013 @08:10AM (#6379908)
Internet Archive?
Re:Getty Just Made 4,600 Images Public Domain by rogerhoward on Friday August 16, 2013 @07:02PM (#6227303)
They had the S3 bucket originally set to allow listing - I grabbed it all before I reported it to an engineer there.

Not going to post a torrent though - mostly cuz you all can figure it out anyhow. The images are all of the form:

NNNNNN01.JPG on that S3 bucket.

NNNNNN is the object ID (the internal record ID of the work of art) zero-padded to 6 digits. The object ID is the same value that appears, for instance, in the URL on their online collection:

URL for Irises: http://www.getty.edu/art/gettyguide/artObjectDetails?artobj=...

URL for the full-rez image on S3: http://gettylargeimages.s3.amazonaws.com/00094701.jpg

You figure it out :)

Re:Getty Just Made 4,600 Images Public Domain by hobs on Friday August 16, 2013 @08:54PM (#6227736)
I dont understand... wouldnt offering a torrent be more friendly than us all downloading it again?
Re:Getty Just Made 4,600 Images Public Domain by 6cxs2hd6 on Saturday August 17, 2013 @09:35PM (#6231209)
Re:Getty Just Made 4,600 Images Public Domain by hobs on Tuesday August 20, 2013 @01:06PM (#6245016)
Thats pretty sweet actually, definitely +1.

I said my original comment because the idea was to have use learn the power of wget by redownloading all files, which seemed pointless to me.

Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @10:51PM (#6231417)
This is exactly how I plan to serve up the compiled archive.
Re:Getty Just Made 4,600 Images Public Domain by toomuchtodo on Saturday August 17, 2013 @10:54PM (#6231425)
1) Iterate through all the search results pages (1-94) to get objectids.

2) Iterate through objectids to fetch the following: a) xml data b) thumbnails (from getty servers) c) original work on cloudfront

You're assuming the convention holds across all ~4600 objects. Never assume. Follow the links.

Re:Getty Just Made 4,600 Images Public Domain by uniclaude on Friday August 16, 2013 @08:19PM (#6227600)
Nice.

That would make a convenient fizzbuzz style interview question.