Ask HN: How do you get started with adding voice commands to a computer system?

Re:Ask HN: How do you get started with adding voice commands... by calebjosue on Tuesday November 21, 2023 @02:51PM (#38369100)

Thank you! Taking a quick look the source code you are linking here I realize you first need to record the audio (again it was a quick look). I am thinking in an human-computer interaction more like the apple remote controller provides you to tell Apple TV applications the command (Most likely a search keyword). You know, no "middle-man", just the audio sent by the user and engine inference to act upon the received data.

[ Parent | on HN ]

Re:Ask HN: How do you get started with adding voice commands... by neontomo on Tuesday November 21, 2023 @03:16PM (#38369438)

I would cut the task into separate problems and solve them one at a time. You could do it like this:

1. Trigger - pressing a button/terminal command

2. Record audio for 5-10 seconds (this will unfortunately lead to silence at the end of the file because it has a set audio length)

3. Run through Whisper API or run locally

4. Manipulate the response (Python can run local commands)

I've been considering building this myself lately for some kind of home-AI on a Raspberry PI, but I don't know if the steps would look exactly like this. My first thought was to cut the audio if it's silent for too long but not sure if you can process it at the same time as recording (probably). ffmpeg has some tools for detecting low dB.

[ Parent | on HN ]

Re:Ask HN: How do you get started with adding voice commands... by smoldesu on Tuesday November 21, 2023 @03:02PM (#38369249)

Generally, you'll have to build that layer yourself. No toolkits or SDKs that I'm aware of let you control a computer with an arbitrary prompt. That would probably be best relegated to an LLM that offers the user a suggested workflow and lets them confirm it.

> I realize you first need to record the audio

There are implimentations that let you stream audio in realtime, but it is rather finnecky and will require basic knowledge of audio DSP. I never set it up though, ymmv.

[ Parent | on HN ]

Re:Ask HN: How do you get started with adding voice commands... by calebjosue on Tuesday November 21, 2023 @05:32PM (#38371390)

Thank you for the answers guys! I think I am going with the API version instead (Sending audio the API). Still, I putting this on hold for the moment. Thanks!!!

[ Parent | on HN ]