News for hackers. Stuff that matters.

A comment on Breaking up with Flask and FastAPI: Why they don’t scale for ML model serving. Parent comment

Re:Breaking up with Flask and FastAPI: Why they don’t scale ... by anderskaseorg on Thursday June 16, 2022 @04:06PM (#31770332)
Great—but then one ought to be able to performantly use that same runner equally well from FastAPI, Starlette, Quart (ASGI port of Flask), or any other ASGI framework. You’ve decided to build a convenient integration with Starlette instead of the others, but it’s weird to frame this as an argument that other frameworks are ill suited for this domain.
[ Parent | on HN ]
Re:Breaking up with Flask and FastAPI: Why they don’t scale ... by chaoyu_ on Thursday June 16, 2022 @08:34PM (#31772700)
That’s is true, it would be more accurate to say FastAPI (or any ASGI) framework along is not enough for ML model serving, you need batching and runner for performance. And some additional Ml focused features for integration with other ML tools
[ Parent | on HN ]