News for hackers. Stuff that matters.

A comment on Ask HN: How to deploy LLMs to serve a million users?. Parent comment

Re:Ask HN: How to deploy LLMs to serve a million users? by travisjungroth on Tuesday April 11, 2023 @05:10PM (#35531613)
It’s not different from other GPU ML deployments, but those are already a little less solved than the standard web API portion.
[ Parent | on HN ]

There are no comments on this comment yet.