Re:vLLM: 24x faster LLM serving than HuggingFace Transformers
by scv119 on Tuesday June 20, 2023 @06:26PM
(#36411560)
Pretty cool stuff and the result are amazing. Hoping we will see virtual memory get standardized in pytorch or cuda.
[ Parent
| on HN ]
There are no comments on this comment yet.