Re:Wootric moved ML deployment pipeline from AWS to GCP
by marinhero on Tuesday April 14, 2020 @01:12PM
(#22868545)
Can you elaborate on what changed from one architecture to the other regarding Custom Models? it feels like it would still be easier to do that on AWS since you control more of the stack. Isn't that the case?
[ Parent
| on HN ]
Re:Wootric moved ML deployment pipeline from AWS to GCP
by rsmith49 on Tuesday April 14, 2020 @01:18PM
(#22868635)
While AWS does allow more hands-on control of the model stack, our "Custom Models" are more just different sets of weights using the exact same methodology. Basically, each customer that creates their own custom model is plugging into our existing framework, but with a different configuration.
Because of this, GCP'S AI Platform allows us a more micro-services type approach to interacting with the ML models themselves - as opposed to our previous deployment strategy on AWS, which put all of the models into one big bucket on every instance that was serving requests.
Hope that answered your question!