News for hackers. Stuff that matters.

A comment on vLLM: 24x faster LLM serving than HuggingFace Transformers. Parent comment

Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by wskwon on Tuesday June 20, 2023 @11:54PM (#36414206)
Thanks! Please try it out and share any feedback you might have.
[ Parent | on HN ]

There are no comments on this comment yet.