News for hackers. Stuff that matters.

A comment on Ask HN: How to deploy LLMs to serve a million users?.

Re:Ask HN: How to deploy LLMs to serve a million users? by uaas on Wednesday April 12, 2023 @03:02AM (#35535951)
There’s this, but it’s two years old now: https://openai.com/research/scaling-kubernetes-to-7500-nodes
[ Parent | on HN ]

There are no comments on this comment yet.