News for hackers. Stuff that matters.

A comment on 200ms Voice LLM. Parent comment

Re:200ms Voice LLM by juberti on Sunday June 09, 2024 @04:21PM (#40627293)
We're running it on vLLM and are working with others in the community to bring it to other optimized inference frameworks.
[ Parent | on HN ]

There are no comments on this comment yet.