News for hackers. Stuff that matters.
Re:Building a fully local LLM voice assistant to control my ... by JohnTheNerd on Saturday January 13, 2024 @06:36PM (#38985848)
that is correct! I would much rather run everything in-house, where I know the quality won't be degraded over time (see the Google Assistant announcement from yesterday) and I am in full control of my data.

using a cloud service is much easier and cheaper, but I was not comfortable with that trade-off.

Re:Building a fully local LLM voice assistant to control my ... by wslh on Saturday January 13, 2024 @06:47PM (#38985931)
Based on your experience and existing code, it is easy to add continuous listening? Have not tested it but probably is already there. For example, I would like to have it always turned on and speaking to it about ideas at random times.
Re:Building a fully local LLM voice assistant to control my ... by canada_dry on Saturday January 13, 2024 @08:33PM (#38986538)
The solution I've got (in alpha) is a basic webcam that detects when you're looking at it.

The cam is positioned higher than most things in the room to reduce triggering it unnecessarily.

When it triggers (currently using just simple cvv facial landmark detection) it emits a beep and then listens for a verbal command.

Re:Building a fully local LLM voice assistant to control my ... by JohnTheNerd on Saturday January 13, 2024 @07:40PM (#38986245)
I never tried it, but I think it would go very poorly without a wake word of sorts.

HomeAssistant seems to natively support wake words, but I haven't looked into it yet. I simply use my smartwatch (Wear OS supports replacing Google Assistant with HomeAssistant's Assist functionality) to interact with the LLM