News for hackers. Stuff that matters.
Re:Breaking up with Flask and FastAPI: Why they don’t scale ... by beckingz on Thursday June 16, 2022 @03:53PM (#31770178)
"FastAPI is not perfect for ML serving"

Yup. There's a huge amount of work that you need to do to do the whole ML lifecycle, and FastAPI doesn't support that out of the box like a full fledged ML Platform.

But you probably don't actually want a full ML Platform because they're all opinionated and if you try and fight them it's often worse than just serving it as an API via FastAPI...

Re:Breaking up with Flask and FastAPI: Why they don’t scale ... by chaoyu_ on Thursday June 16, 2022 @08:36PM (#31772720)
Exactly! A vertical solution focused on model serving and deployment would make more sense if it can easily integrate with the ML training platform for CICD
Re:Breaking up with Flask and FastAPI: Why they don’t scale ... by alpineidyll3 on Thursday June 16, 2022 @04:40PM (#31770717)
Yeah... I mean the author is blatantly biased, but his low level discussion is cogent.