Re:Breaking up with Flask and FastAPI: Why they don’t scale ...
by chaoyu_ on Thursday June 16, 2022 @08:34PM
(#31772700)
That’s is true, it would be more accurate to say FastAPI (or any ASGI) framework along is not enough for ML model serving, you need batching and runner for performance. And some additional Ml focused features for integration with other ML tools
[ Parent
| on HN ]
There are no comments on this comment yet.