News for hackers. Stuff that matters.

A comment on A Python Library to 6-7x the inference speed of your HF models. Parent comment

Re:A Python Library to 6-7x the inference speed of your HF m... by theboat on Thursday February 22, 2024 @12:19AM (#39463517)
does this work for diffusion models, e.g. stable diffusion xl?
[ Parent | on HN ]
Re:A Python Library to 6-7x the inference speed of your HF m... by jurgenaut23 on Thursday February 22, 2024 @12:26AM (#39463569)
A quick look at the codebase seems to indicate that it doesn't. This seems very targeted at LLMs.
[ Parent | on HN ]