Re:vLLM: 24x faster LLM serving than HuggingFace Transformers
by wskwon on Tuesday June 20, 2023 @03:17PM
(#36409083)
vLLM has been adopted by LMSYS for serving Vicuna and Chatbot Arena.
[ Parent
| on HN ]
There are no comments on this comment yet.