News for hackers. Stuff that matters.

A comment on A Python Library to 6-7x the inference speed of your HF models. Parent comment

Re:A Python Library to 6-7x the inference speed of your HF m... by jurgenaut23 on Thursday February 22, 2024 @12:26AM (#39463569)
A quick look at the codebase seems to indicate that it doesn't. This seems very targeted at LLMs.
[ Parent | on HN ]

There are no comments on this comment yet.