News for hackers. Stuff that matters.

A comment on A Python Library to 6-7x the inference speed of your HF models. Parent comment

Re:A Python Library to 6-7x the inference speed of your HF m... by jph00 on Thursday February 22, 2024 @03:36AM (#39464660)
vLLM uses transformers.
[ Parent | on HN ]

There are no comments on this comment yet.