News for hackers. Stuff that matters.

A comment on vLLM: 24x faster LLM serving than HuggingFace Transformers. Parent comment

Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by mattnewton on Tuesday June 20, 2023 @06:40PM (#36411721)
Google slides I think.
[ Parent | on HN ]

There are no comments on this comment yet.