morehamish
Re:Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/...
on Tuesday May 23, 2023 @11:10AM (#36045427)
Brilliant. Willow looks like a game-changer to me, thanks a million!
Re:Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/...
on Tuesday May 23, 2023 @11:02AM (#36045312)
Great stuff. Which video card are you running in the demo video?
Re:Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/...
on Tuesday May 23, 2023 @10:52AM (#36045165)
Looks fantastic! A question re. benchmarks: the "realtime multiple" means "how many times faster the model is processing the audio compared to real time" here? (I.e. the opposite of "real-time factor" sometimes used in speech recognition contexts?)
Also bigger beam sizes give better quality I guess?
Tnx!
Re:Show HN: Willow – Open-Source Privacy-Focused Voice Assistant Hardware
on Wednesday May 17, 2023 @11:34AM (#35976810)
What sort of hardware is the inference server at infer.tovera.io currently running on? Tnx!