Re:Breaking up with Flask and FastAPI: Why they don’t scale ...
by chaoyu_ on Thursday June 16, 2022 @08:36PM
(#31772720)
Exactly! A vertical solution focused on model serving and deployment would make more sense if it can easily integrate with the ML training platform for CICD
Re:Breaking up with Flask and FastAPI: Why they don’t scale ...
by alpineidyll3 on Thursday June 16, 2022 @04:40PM
(#31770717)
Yeah... I mean the author is blatantly biased, but his low level discussion is cogent.
Yup. There's a huge amount of work that you need to do to do the whole ML lifecycle, and FastAPI doesn't support that out of the box like a full fledged ML Platform.
But you probably don't actually want a full ML Platform because they're all opinionated and if you try and fight them it's often worse than just serving it as an API via FastAPI...