andrewzhai

Here are some of the technologies we use:

Caffe - deep learning feature computation and model training

OpenCV - local + other features

Zookeeper - service discovery

Cascading - batch processing jobs

We’ve built infrastructure around some of these libraries to operate at scale. For example we’ve build an incremental feature extraction pipeline that at the core uses caffe + opencv for the feature extraction (more details on how this works is in the paper).

We serve our infrastructure through ec2.