News for hackers. Stuff that matters.
Re:Apple hires CMU professor as director of AI research to s... by future1979 on Tuesday October 18, 2016 @04:44AM (#12732948)
Can you point at a good survey article, blog post, course or book that goes into the NLU aspect? I've watched a bunch of courses on DNN but feel that stuff doesn't apply well to NLU aspects. The speech rec stuff used to be done with HMMs until recently but as you said, DNN is now the way to go for it.
Re:Apple hires CMU professor as director of AI research to s... by hiddencost on Saturday October 22, 2016 @12:48PM (#12769392)
(also, sorry, the speech stuff was using HMM+GMM models, and now mostly use HMM+DNN models [so, we replaced the gaussian mixture model with a DNN, but kept the HMM], although some people are moving over to RNN models which doesn't use HMMs (connectionist temporal classification))

This is a great course, about NLP generally:

http://cs224d.stanford.edu/syllabus.html

A typical NLU system might be:

an intent classifier to predict intent (e.g., "play music"). This can be pretty much anything (SVM, logistic regression, RNN, I don't care, try stuff and see what works for you)

a segmentation model or slot-filling model (so label every word as either junk or "album name" or "song name" or whatever). This requires a sequence model, e.g., HMMs, CRFs, LSTM-RNNs.

Here's a nice example:

https://www.microsoft.com/en-us/research/wp-content/uploads/...