News for hackers. Stuff that matters.
Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by jmmcd on Monday January 02, 2017 @05:19PM (#13305036)
There's a good point to be made about continuous functions, but the author hasn't made it, because he/she doesn't know the difference between continuous functions and time-series.

> What is a continuous function (or continuous data)? It is a sequence where each item is related to the one before and one after determined by a process.

So, to paraphrase the article: My reply should actually stop here with one sentence.

Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by fnl on Monday January 02, 2017 @05:38PM (#13305154)
I agree that the author's interpretation of a continuous function is -umm- lacking, but I think it is thought provoking if you try to read it as what he probably meant, a continuous topological mapping from the character sequence to some function of the semantics of the text. Assuming that mapping does not exist would imply that we'd need more than a LSTM to build a proper language model some day. Yet, LSTMs are probably as close to a perfect model as we can currently get... So maybe this line of thought can help somebody imagine the "missing piece"?