News for hackers. Stuff that matters.

A comment on Offline Voice Assistant on a Microcontroller with 192KB RAM.

Re:Offline Voice Assistant on a Microcontroller with 192KB RAM by brink on Monday December 12, 2022 @11:19PM (#33964784)
What's their trick for its voice recognition on something so small if something like openai's whisper requires torch, which is almost a gig in size?
[ Parent | on HN ]
Re:Offline Voice Assistant on a Microcontroller with 192KB RAM by kenarsa on Monday December 12, 2022 @11:41PM (#33964932)
context, context, and context!! Then deep learning tricks and efficient implementation.

[1] https://picovoice.ai/blog/end-to-end-intent-inference-from-s...

[ Parent | on HN ]
Re:Offline Voice Assistant on a Microcontroller with 192KB RAM by nshm on Tuesday December 13, 2022 @03:36PM (#33975361)
There are Whisper TFLite ports with model 40Mb size and tflite itself is about 3Mb. So nowhere near a gig. https://github.com/usefulsensors/openai-whisper
[ Parent | on HN ]
Re:Offline Voice Assistant on a Microcontroller with 192KB RAM by brink on Tuesday December 13, 2022 @06:54PM (#33978039)
Thank you!
[ Parent | on HN ]