News for hackers. Stuff that matters.
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by rohan_ on Friday March 14, 2025 @08:09PM (#43368646)
do you think it's feasible to create a Gen AI version of Alexa completely locally? unsure what exactly you're trying to say.
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by KetoManx64 on Friday March 14, 2025 @11:45PM (#43369810)
HomeAssistant already does
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by wkat4242 on Saturday March 15, 2025 @01:12PM (#43373815)
Hmm yeah but it needs 30 seconds to give an answer. And that's with the LLM running on a GPU with HBM2 memory.
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by bttrpll on Saturday March 15, 2025 @03:08AM (#43370625)
yes. that was the original design actually. and it worked. latency was a bit much though.
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by ben_w on Saturday March 15, 2025 @11:18AM (#43373077)
It's not "Gen"erative, but is still a Transformer, and is kinda OK: https://github.com/openai/whisper

(I'm not too impressed with the error rate, but OTOH Alexa and Siri mishear me fairly often as well, so Whisper may be "good enough").

Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by throwawaymaths on Saturday March 15, 2025 @01:32PM (#43373942)
its feasible. if you want to try yourself you can start with the april-asr package.
Re:Amazon Is Discontinuing the "Do Not Send Voice Recordings... by cantrecallmypwd on Saturday March 15, 2025 @07:47PM (#43375947)
There are tools to make your own.