A Python Library to 6-7x the inference speed of your HF models

Re:A Python Library to 6-7x the inference speed of your HF m... by codethief on Thursday February 22, 2024 @04:39AM (#39465036)

+ setup instructions please :)

[ Parent | on HN ]

Re:A Python Library to 6-7x the inference speed of your HF m... by MDK8888 on Thursday February 22, 2024 @10:16PM (#39476531)

Hey, hope you're doing well! I've updated the repo with instructions on how to get started and documentation!

[ Parent | on HN ]

Re:A Python Library to 6-7x the inference speed of your HF m... by codethief on Saturday February 24, 2024 @07:08PM (#39496315)

Thanks, I'll have a look!

[ Parent | on HN ]