News for hackers. Stuff that matters.
Re:Whatever Happened to Voice Recognition? by gahahaha on Monday June 21, 2010 @09:37AM (#1448741)
He is wrong about the accuracy of speech recognition. I know he is wrong because I have actually used Speech Recognition to get real work done. AND to make it worse I have a crap Norwegian accent.

MAYBE it is as bad as he describes when you do not train the system and just start speaking. But that is like complaining about Emacs after using it for only 10 minutes. Retarded.

I wouldn't be able to code with it though, but for producing prose in English. It. Actually. Works.

(I recognize that the problems described in the post is about recognition "in the wild" and not with one person in one quiet room with one microphone like I use it)

Re:Whatever Happened to Voice Recognition? by WalterGR on Monday June 21, 2010 @10:19AM (#1448847)
He is wrong about the accuracy of speech recognition. I know he is wrong because I have actually used Speech Recognition to get real work done.

As have I. The dictation capability built in to Vista / Windows 7 is really quite amazing. (They both also have voice control.)

I'm an extremely fast typer, but dictating - even with time spent correcting mistakes - is quite a bit faster.

Re:Whatever Happened to Voice Recognition? by ableal on Monday June 21, 2010 @11:12AM (#1449019)
> dictation capability built in to Vista / Windows 7

I'll be ... yep, tucked well away under Accessories/Ease of Access. Who knew? (Six month old laptop w/ Win7, successor to an XP machine.)

Needs setup and the, so-far unused, built-in mic is not cooperating. It does say it allows text dictation, besides OS voice control.

Re:Whatever Happened to Voice Recognition? by WalterGR on Tuesday June 22, 2010 @03:27AM (#1451214)
I'll be ... yep, tucked well away under Accessories/Ease of Access. Who knew?

And try this one on for size: Microsoft Office 2003 came with built-in voice control and dictation, which could also be used in other applications!

Re:Whatever Happened to Voice Recognition? by ableal on Tuesday June 22, 2010 @07:04AM (#1451512)
Thanks. I was just thinking "why don't they demo this" and then remembered - they did, back in 2006, and it went embarrassingly wrong: http://en.wikipedia.org/wiki/Windows_Speech_Recognition#cite...
Re:Whatever Happened to Voice Recognition? by WalterGR on Tuesday June 22, 2010 @07:18AM (#1451536)
Yes, it did. But be careful:

"In 2007, reports surfaced that Windows Speech Recognition could be used to remotely access and/or control a user's computer. Theoretically, playing a pre-recorded message containing Windows Speech Recognition commands could allow one to execute tasks on another computer remotely."

Why, that reads like a Wikipedia article about a Microsoft product!

Re:Whatever Happened to Voice Recognition? by ableal on Tuesday June 22, 2010 @09:22AM (#1451770)
I think that anyone who ever gave a non-rigged demo will feel a painful twinge of sympathy for the engineer in that one - "There, but for the grace of God, go I" ...

(And, yes, the "security" issue is pretty far-fetched but is factual, I remember it being raised.)

Re:Whatever Happened to Voice Recognition? by adammichaelc on Monday June 21, 2010 @11:47AM (#1449115)
For getting a wordy essay or report done, voice transcription is far and away the best option. You can talk 150-170 wpm, but can only type 60-80 wpm. I have a friend who swears by Dragon, and has used it to crank out more papers in a shorter time.

I think the reason people haven't adopted voice transcription is because (1) they don't realize that some of the programs out there have reached the 99% accuracy level, (2) we all have developed the habit of working with a computer with our fingers - breaking habits is hard and (3) -related to 2- our brains have been trained to think as we type in ways that allow us to get certain work done, and if we moved over to getting our work done via voice, there are neural connections we'd have to re-create through training.

Re:Whatever Happened to Voice Recognition? by CWuestefeld on Monday June 21, 2010 @12:05PM (#1449182)
For this to work you'd have to have the whole essay mapped out in your mind at the outset.

For me, writing with a word processor is not just about setting down my words, but even before that, setting down the structure of the essay, then going back into it non-sequentially to flesh it out.

I can't imagine how that would be workable, even if the speech recognition were perfect. Things like "go back to the first paragraph of the section, now after the first sentence insert X" is unwieldy, and bound to take far longer than traditional cursor control with keys or mouse.

Re:Whatever Happened to Voice Recognition? by scott_s on Monday June 21, 2010 @01:54PM (#1449505)
I had a similar thought: how much of the writing process for me is keyed up by actually writing it? That is, I think that the act of typing is now, in my brain, tied to the creative process of writing. I could adapt, of course, but it would take time and effort.
Re:Whatever Happened to Voice Recognition? by demallien on Monday June 21, 2010 @10:57AM (#1448977)
The promess of Voice Recognition has never been the actual transcripting of the spoken word - although even that would be quite useful if a high degree of accuracy is achieved - but rather in the idea of controlling a computer by simply talking to it using natural language. People want the computer to behave as if it is a colleague, not a machine.

Of course we're a long way from that goal. Firstly, people don't understand just how difficult it is to express clearly what it is that you want. I have a good friend that had bought an iPhone whilst she was living abroad for 6 months. On returning back home, she wanted to be able to add new songs to her iPhone without losing the stuff already on there. That's how she described the task to me, as the go-to person for computer problems. So I started asking a bunch of questions - do you still have the same computer that you were using abroad? Do you want copy the music already on the iPhone onto your computer? What about other data on the iPhone, do you need to recover that too, or can I blow it away? She got very frustrated with all of these questions and finally just snapped "Oh, you know what I mean, I just want to be able to use my iPhone normally, including adding new stuff to it!"

Sigh. She really didn't (doesn't) understand that this just isn't enough information for me to work with - and that's me, as a walking talking human being with a strong understanding of what the computer is doing. How is a computer, with problems in transcribing the spoken words, let alone understanding the underlying meaning of those words, and not having any idea of the real world context of the problem, supposed to figure out what she wanted?

Re:Whatever Happened to Voice Recognition? by kristiandupont on Monday June 21, 2010 @11:59AM (#1449159)
There are some cases where this makes sense but there are also a lot of situations where I want my computer to be just that - not a colleague. Simply because many of the tasks that I perform on it are trivial and repetitive and easy to trigger with keystrokes and mouse clicks. It would be annoying to me and the rest of the office if I was speaking each command.
Re:Whatever Happened to Voice Recognition? by dazzawazza on Monday June 21, 2010 @08:15AM (#1448547)
I worked with a coder about 10 years ago who had been looking into speech recognition for video games. He came up with some pretty interesting prototypes that he ultimately had to throw away. His companies legal department told him speech recognition is a legal minefield with most algorithms patented and some very trigger happy lawyers defending those patents.

In the end they went with an inferior solution from one of the big hardware manufacturers who coincidentally were also mentioned by the legal team as a patent holder.

So maybe real research is being hampered?

Re:Whatever Happened to Voice Recognition? by arethuza on Monday June 21, 2010 @09:32AM (#1448718)
Some games do have voice control - Rainbow Six: Vegas on the Xbox 360 allows you to give order to your computer controlled teammates.
Re:Whatever Happened to Voice Recognition? by Tycho on Monday June 21, 2010 @10:30AM (#1448893)
I remember Rainbow 6 III Black Arrow or something had very usable voice recognition for the solo game. You basically had a few commands like 'regroup,' 'go go go,' 'hold this position' which worked out better than button commands. It seemed to disappear in subsequent Tom Clancy games but glad to hear they brought it back for Vegas.

I think the key with speech recognition and natural language processing is to forget the HAL9000/StarTrek 'hello computer' nonsense, and focus on constrained domains augmented by other technologies.

Touchpad keyboards are blatantly less usable than hard keyboards but by the time you factor in a) portability and b) auto-completion of words/urls/search-strings, then they become a more than viable alternative.

People have incredibly adaptive linguistic skills, developers should harness this more IMO rather than be overly ambitious with NLP.

That said I was very impressed with the accuracy of Google's voice search app. But like Jeff Atwood says, it's easier just to search normally.

Re:Whatever Happened to Voice Recognition? by kmfrk on Monday June 21, 2010 @09:49AM (#1448769)
Having Microsoft and other platform owners to cover your back as a semi-big game also helps. :)
Re:Whatever Happened to Voice Recognition? by dazzawazza on Monday June 21, 2010 @10:01AM (#1448795)
I'd be willing to bet that they use the hardware vendors solution. I'm sure both MS and Sony provide libraries for XBox 2 and PS3 (not sure about Wii).
Re:Whatever Happened to Voice Recognition? by zokier on Monday June 21, 2010 @11:32AM (#1449078)
Tom Clancy's Endwar had quite prominent voice recognition interface.
Re:Whatever Happened to Voice Recognition? by cdavid on Monday June 21, 2010 @11:32AM (#1449080)
I don't think this is an issue, at least in academia. The one case where patent has been an issue is speech synthesis, where the PSOLA method has been patented and was the state of the art for quite some time.

I am not an expert on speech recognition, but I have done my PhD in a speech lab, so I have at least an idea on the issues. Almost every current speech recognizer is divided into two parts: the acoustical modeling (from audio file to "phonemes"), and language models (from "phonemes" to words).

Most people working on acoustical modeling are interested in difficult situations (multi speakers, noisy speech, etc... where performances are nowhere near human in general).

The language modeling part has to deal with sparsity: the idea is to model the probability of getting a work w_n given that the previous words were (w_n-1, w_n-2, ...). Given that vocabularies (numbers of possible words) are of the order of millions for large vocabulary recognition, you can imagine that many (most) combinations are never seen in the training data (trillions and more combinations), so you have to somewhat "smooth" the data, remove early "impossible" combinations., etc... There are a lot of heuristics.

Also, even though the author is a bit off on the timing, he is right that the basic methods are the same for a long time (statistical, data-driven, HMM for the acoustical model). Sure, we now have (somewhat) speaker-independent models so that you don't have to train the model with your own voice for hours anymore, and language models can handle large vocabularies, but the basics are really the same. A researcher who would have hibernated 20 years ago and just woke up would be able to update in no time.

Proposing a new system is difficult, because the current systems are extremely hard to beat: the state of the art requires thousand of hours of training, which means you are almost required to use a lot of programs outside your own lab. For example, almost everyone uses the same software for acoustical modelling (HTK), same labeled data, etc... The published improvements are often tiny (less than one point, e.g. going from 79 % to 80 %), and I actually wonder if those are scientifically significant.

Using things like pitch and other non verbal cues (prosody is the actual term used in the literature) is often suggested, but estimating those reliably is extremely difficult. I would guess this will improve because some of languages which are currently funded require prosodic information. Chinese is the obvious example: Chinese has the notion of tones, where the pitch of phonemes may radically change the meaning of the word.

On the bright side, I think speech recognition was one of the first field which pushed the idea of data-driven models (at least 3 decades when the first usage of HMM appear), and as such, has been on the forefront of the current explosion of non trivial statistical models trained on big datasets. In that sense, I think it had non trivial contribution outside its own application.

Re:Whatever Happened to Voice Recognition? by Retric on Monday June 21, 2010 @01:52PM (#1449499)
divided into two parts: the acoustical modeling (from audio file to "phonemes"), and language models

That seems a little off to me. It seems like you would want a list of phoneme probabilities to work with along with how long each sound took etc. Your language model might say “I saw the see past the dune” is less likely than “I saw the sea past the dune” but the more information the language model has to work with the better. For example, dialect impacts both the sounds people use and the words they use.

Also sperating background sounds from a message is easer if you are following the content of the message etc.

Re:Whatever Happened to Voice Recognition? by robryan on Monday June 21, 2010 @11:03AM (#1448997)
I think we get the impression at times that no matter what there is always an army of people quietly working away on this stuff and as time passes it will get better and better.

The article Jeff linked talks about how how the performance has pretty much levelled off except for small incremental improvements and most of the money and research was shifted away from the area. I guess the trend will continue, gaining small improvements through applying more and more data as training for current methods until someone comes up with a completely different approach to push it forward.

Re:Whatever Happened to Voice Recognition? by garribas on Monday June 21, 2010 @10:05AM (#1448804)
Robert Fortner's article "Rest in Peas: The Unrecognized Death of Speech Recognition" was discussed recently on HN, a must read for those interested in speech recognition.

http://news.ycombinator.com/item?id=1313679

Re:Whatever Happened to Voice Recognition? by superdavid on Monday June 21, 2010 @08:20AM (#1448562)
So many "new interface" ideas seem to forget that a large percentage of what people use computers for is in offices, producing documentation. Using your voice, or spinning 3D interfaces around with your hands, just isn't practical in an office environment with dozens of people working, where you are essentially outputting text.

Until that basic reality changes, I don't think mainstream computing needs will change. Along the same lines, I don't think the reverse is feasible, with computing interface changes bringing about social changes. The shifts we've seen from hand-writing to type-writing to computer-based word-processing has been happening in roughly the same environment for a very long time.

Re:Whatever Happened to Voice Recognition? by iamdave on Monday June 21, 2010 @08:35AM (#1448594)
Not to state that the exception proves the rule, but my company actually makes use of two racks of IVR servers on a daily basis and we love them. Speeds up the inbound call process ten fold from 2009.
Re:Whatever Happened to Voice Recognition? by CWuestefeld on Monday June 21, 2010 @09:23AM (#1448699)
I despise these things, and I don't know of anyone who disagrees. If you're seeing an improvement, then I guess most of the world treats them differently than I do.

As soon as I hear "If you want X, please say...", I start pounding the zero button. The thing is, relying on buttons is not only faster in itself, but also doesn't force me through so many "you said 'X'; is that correct?" questions.

If it were something straightforward I would already have helped myself on your website. The fact that I'm on the phone means that it's an open-ended question requiring a real human on the other end (or that your website is useless).

Re:Whatever Happened to Voice Recognition? by jerf on Monday June 21, 2010 @09:49AM (#1448772)
What fails is general-purpose voice recognition. Constrained voice recognition, like "recognize these 10 digits and four options" works fine, though it still needs more metaphorical hand holding than a human would. ("OK, please say a number." "Two." "... ... ... I think you said two? If so, please say yes." "Yes." "... ... ... OK, I guess you're done talking. Now let's move to the next option." Humans don't need the "... ... ...".)
Re:Whatever Happened to Voice Recognition? by jimmyjim on Monday June 21, 2010 @10:19AM (#1448851)
I think there have been numerous acquisitions of voice/speech-recognition startups by both Google and Apple (http://www.enterprisemobiletoday.com/news/article.php/387924...), because indeed it's very clear that it's going to be a thing of the future, with nlp.

And we're probably not much into it just because of how impenetrably tortuous it is. Almost everything related to it is variable -- culture is always evolving language, slangs die of usage over time, and there are accents to worry about. With all of these problems, there is the demand in tandem for progress in nlp areas to deal with -- where really some of the most difficult challenges lie ( http://en.wikipedia.org/wiki/Natural_language_processing#Con... ). With all that said, I have my money down on Google. They seem to be doing a lot of work in areas where the variability of these tasks is required. Presently, the voice transcription feature on youtube seems fairly impressive, and I've noticed in the past google search's nlp abilities to be curiously good, certainly more far ahead than any other search engine today.

Re:Whatever Happened to Voice Recognition? by edo on Monday June 21, 2010 @08:05AM (#1448532)
Can anyone tell me why we aren't able to progress into better levels of recognition. Am I correct to assume it has nothing to do with computing power, and everything to do with (semantic/linguistic) software?
Re:Whatever Happened to Voice Recognition? by compay on Monday June 21, 2010 @09:20AM (#1448696)
It's more than just linguistic software. Our knowledge of linguistics itself is currently very limited; it's a nacent science and there's still a great deal of debate about how to even approach the study of language. Even leaving aside the difficulties in just transcribing speech, linguists are still a long ways off from coming up with any formalism of human syntax that could help create software to syntactically parse normal human speech.
Re:Whatever Happened to Voice Recognition? by CWuestefeld on Monday June 21, 2010 @09:27AM (#1448707)
...because most of our linguistic formalism is derived from written language, which is generally an artificial approximation of real language.

Remember grade school, with parts of speech, Conjunction Junction, and diagramming sentences? Well, think back to the last (non-trivial) sentence you actually said out loud. I challenge you to try to diagram that sentence.

Although there's quite a lot of research that's been done, surprisingly little of it deals with the way most of us really communicate.

Re:Whatever Happened to Voice Recognition? by compay on Monday June 21, 2010 @10:33AM (#1448906)
Modern linguistic formalism is not derived from written language at all. I studied at MIT and UConn in the mid '90's and the separation between prescriptive grammar and linguistics is pretty clear.

That's not to say that current approaches to linguistics are correct; I don't know enough to make that judgement. But I think the problem lies more in the complexity of the domain - not because modern linguists are so foolish as to base theory on written language.

Re:Whatever Happened to Voice Recognition? by CWuestefeld on Monday June 21, 2010 @12:00PM (#1449165)
It's quite possible I'm behind the times.

not because modern linguists are so foolish as to base theory on written language

That was actually what I was trying to get at. While there are clearly some rules we follow when speaking, they are much more open than those governing our writing.

It's odd, though, or at least counterintuitive, that our comprehensive of these less-structured spoken communications is higher than that of more-structured written ones.

Re:Whatever Happened to Voice Recognition? by woodson on Monday June 21, 2010 @09:49AM (#1448768)
In fact, it has been shown that there are languages that have syntactic constructions which are context-sensitive (in a generative linguistic PoV. cf. http://en.wikipedia.org/wiki/Chomsky_hierarchy). For example Swiss German variants (http://books.google.com/books?id=JOjoWrP4tnIC&lpg=PA165&...)
Re:Whatever Happened to Voice Recognition? by mstoehr on Monday June 21, 2010 @11:10AM (#1449016)
Most commenters are focusing on relatively high level features of decoding speech. It is important to also be aware that there is still great debate about what are the acoustic correlates of linguistic events in speech. It seems that our words are composed of subunits (usually taken to be phones out of the IPA--but there's work on alternatives) but what exact acoustics correspond to the phones are is still unsettled: lots of debate and mediocre recognition performance

Undoubtedly there is much room for improvement on these higher-level features but computers are still well behind humans in large vocabulary isolated keyword spotting: this is a task where one word from a very large corpus of words is spoken and the human or computer has to guess what that word was. Computers do poorly relative to humans (particularly in noise), which suggests that many of the mistakes that computers make is in not being able to interpret the acoustics correctly.

Re:Whatever Happened to Voice Recognition? by algorias on Monday June 21, 2010 @12:19PM (#1449232)
And to make this problem worse, there's a great deal of variation among different dialects of the same language, which means that there's no 1:1 mapping of IPA phones to written letters.
Re:Whatever Happened to Voice Recognition? by ashbrahma on Monday June 21, 2010 @11:56AM (#1449144)
And I thought only us Indians and Chinese were having issues with voice recognition software..