News for hackers. Stuff that matters.

A comment on Ask HN: Is there any work being done in speech-to-code with deep learning?.

Re:Ask HN: Is there any work being done in speech-to-code wi... by daanzu on Saturday June 13, 2020 @02:42AM (#23507363)
Windows Speech Recognition is far from the best, so perhaps your trouble could be partly caused by how you had to speak in order to be understood, rather than the command style? I used to use WSR to code by voice, and it was far more laborious than my current setup.

I develop kaldi-active-grammar [0]. The Kaldi engine is state of the art for command and control. Although I don't have the data and resources for training a model like Microsoft/Nuance/Google, being an open rather than closed system allows me to train models that are far more personalized than the large commercial/generic ones you are used to. For example, see the video of me using it [1], where I can speak in a relaxed manner without having to over enunciate and strain my voice.

Gathering the data for such training does take some time, but the results can be huge [2]. Performing the actual training is currently complicated; I am working on making it portable and more turnkey, but it's not ready yet. However, I am running test training for some people. Contact me if you want me to use you as a guinea pig.

[0] https://github.com/daanzu/kaldi-active-grammar

[1] https://youtu.be/Qk1mGbIJx3s

[2] https://github.com/daanzu/kaldi-active-grammar/blob/master/d...

[ Parent | on HN ]
Re:Ask HN: Is there any work being done in speech-to-code wi... by GordonS on Saturday June 13, 2020 @06:46AM (#23508524)
> Performing the actual training is currently complicated; I am working on making it portable and more turnkey, but it's not ready yet

I'm eagerly awaiting this! If I wanted to try to get something working now, I'd need to invest a lot of time - being able to get started quickly would be amazing.

[ Parent | on HN ]
Re:Ask HN: Is there any work being done in speech-to-code wi... by StavrosK on Saturday June 13, 2020 @01:42PM (#23511140)
It looks like Kaldi can use different backends, which I imagine have very different performance characteristics. Can you rank them from best to worst, with relative distances?
[ Parent | on HN ]
Re:Ask HN: Is there any work being done in speech-to-code wi... by daanzu on Saturday June 13, 2020 @09:25PM (#23514364)
Just to be clear, the Dragonfly speech recognition command and control framework has multiple "backends" (speech recognition engines), including my Kaldi one. Probably the most used one currently is the Dragon Naturally Speaking backend.

The Kaldi engine, being developed primarily for research in speech recognition, can support a huge variety of "models". I think the consensus general best for most use cases (particularly for real time, low latency, streaming use) currently would be considered to be the "nnet3 chain" models, which are what my kaldi-active-grammar uses/supports.

[ Parent | on HN ]
Re:Ask HN: Is there any work being done in speech-to-code wi... by StavrosK on Monday June 15, 2020 @07:16AM (#23526134)
Thank you, I think I understand partially, but not fully, as I'm not very well versed in speech recognition software.

Basically, my question (and I assume many other users') is "I run <Linux/Windows/Mac OS>, what are my options and how good will my recognition be with each?". Your answer above helps, but it doesn't entirely satisfy me, as I'm not sure if a model is the recognition engine, or if the engine uses the model, or how I can use it, etc.

[ Parent | on HN ]