News for hackers. Stuff that matters.
Re:Extracting image metadata at scale by Xyik on Monday March 21, 2016 @03:42PM (#11331215)
don't think it actually talks much about how it does it at ' scale'. how expensive is it to perform these operations? are images cropped dynamically as they are requested or do they pre-process the images and cache it somewhere.

did they do anything clever to parallelize the process? what underlying technologies do they use...

Re:Extracting image metadata at scale by maciejgryka on Monday March 21, 2016 @03:45PM (#11331238)
From the code samples, it looks like OpenCV... which is pretty hard to beat for well-understood image processing algos like thresholdling etc.

I guess at this point you can do it "at scale" by throwing enough servers and caching at the problem :)

Re:Extracting image metadata at scale by zitterbewegung on Monday March 21, 2016 @11:43PM (#11334292)
It would be more interesting to see what they are using to manage the servers and run opencv which is what the comment was asking .