Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot

Re:Show HN: WhisperFusion – Ultra-low latency conversations ... by WhackyIdeas on Monday January 29, 2024 @03:50PM (#39182370)

I had a quick read through, maybe I missed something but is this all local run or does it need api access to OpenAI’s remote system?

The reason I ask is that I’m building something that does both TTS and STT using OpenAI, but I do not want to be sending a never ending stream of audio to OpenAI just for it to listen for a single command I will eventually give it.

If I can do all of this local and use Mistral instead, then I’d give it a go too.

[ Parent | on HN ]

Re:Show HN: WhisperFusion – Ultra-low latency conversations ... by renus on Monday January 29, 2024 @03:55PM (#39182448)

Everything runs locally, we use:

- WhisperLive for the transcription - https://github.com/collabora/WhisperLive - WhisperSpeech for the text-to-speech - https://github.com/collabora/WhisperSpeech

and an LLM (phi-2, Mistral, etc.) in between

[ Parent | on HN ]

Re:Show HN: WhisperFusion – Ultra-low latency conversations ... by WhackyIdeas on Monday January 29, 2024 @04:04PM (#39182571)

Thank you! When I read OpenAI I was thinking would be going through them. This revelation is perfect timing for me… keeping user data even more private. Excellent!

[ Parent | on HN ]