Re:Machine Learning Deployment Frameworks
by inf3cti0n95 on Wednesday March 13, 2019 @11:48AM
(#19379834)
The problem is, I have to build a generic deployment system for the researchers. To deploy their Model.
Inference frequency would be quite low, but multiple models could be deployed at time.
Re:Machine Learning Deployment Frameworks
by pplonski86 on Tuesday March 19, 2019 @11:57AM
(#19432030)
I think generic deployment system can be very difficult to build. For example, there can be problems with library dependence or data format dependence. I think you should select one 'family' of models, for example narrow down to only python scikit-learn models, and try to build a system for them.
What kind of algorithm have you used for model building?
How frequently would you like to request the model for predictions?
Do you need scheduled model updates?