Re:Home Assistant 2023.11
by pierregillesl on Thursday November 02, 2023 @11:44AM
(#38115141)
Nice! What languages do you support? (for STT & TTS)
Re:Home Assistant 2023.11
by kkielhofner on Thursday November 02, 2023 @03:44PM
(#38118954)
Thanks!
STT is "just" a very heavily optimized (beyond even faster-whisper) Whisper implementation, so all of those languages[0].
For TTS we now use Coqui, which has a wide range of models with various voices, languages, etc. It even supports Meta MMS which has support for 1,100 languages[1].
[0] - https://github.com/openai/whisper#available-models-and-langu...
[1] - https://about.fb.com/news/2023/05/ai-massively-multilingual-...
Re:Home Assistant 2023.11
by pierregillesl on Friday November 03, 2023 @04:33AM
(#38125976)
Ok! And what kind of hardware do your users run on? Do you get great quality of detection like Google Home/Alexa speakers?
Would you be interesting in integrating with my project Willow[0]?
Willow supports Home Assistant, OpenHAB, and generic REST+MQTT endpoints today. With Home Assistant and OpenHAB we benefit from their specific API support for providing speech to text output and processing through things like the HA Assist Pipelines[1].
From our standpoint we handle wake word, VAD+AEC+BSS, STT, TTS, user feedback, etc. All we really do is send the speech transcript to the Willow command endpoint (like HA) and speak+display the execution result. Other than all of the wild speech stuff and our obsession with speed and accuracy Willow is really quite "dumb" - think of it as a voice terminal.
OpenHAB has something similar but it's significantly more limited.
[0] - https://heywillow.io
[1] - https://developers.home-assistant.io/docs/voice/pipelines/