Re:Ask HN: What are some good architectures for building rec...
by wballard on Wednesday April 18, 2018 @05:03AM
(#16865821)
Besides reduction to search — solr / elastic / Lucerne / xapian, which is the most common approach I have used commercially, my actual favorite is precomputation.
At the moment, keras embedding model, multiprocessing, annoy, and emitting csv (object id, other object id, score) as a batch process and loading it in my database. Queryti recommend. This trades a prebuilt for near instant runtime and — near Nothing net new to break.
I’m working at commercial — 2-5 million item — scale, not ‘internet scale’ billions of items.
At the moment, keras embedding model, multiprocessing, annoy, and emitting csv (object id, other object id, score) as a batch process and loading it in my database. Queryti recommend. This trades a prebuilt for near instant runtime and — near Nothing net new to break.
I’m working at commercial — 2-5 million item — scale, not ‘internet scale’ billions of items.
Hope that helps.