What are the limits of deep learning?

Re:What are the limits of deep learning? by yorwba on Wednesday January 23, 2019 @05:52PM (#18984033)

> Would it help if I gave you all the possible ways that every word in the language those words are drawn from are to be articulated together, without telling you what any of those wors mean? And how would I explain those words' meaning without recourse to words whose meaning you already know?

That's why I linked the two papers on unsupervised machine translation. Given enough text in an unknown language, it is already possible to turn those unknown words into words which humans understand.

[ Parent | on HN ]

Re:What are the limits of deep learning? by YeGoblynQueenne on Wednesday January 23, 2019 @06:28PM (#18984312)

But that's humans. Humans already understand language.

I don't disagree that humans can extract meaning from language models. But that only speaks to the ability of humans to extract meaning from even very badly formed language. Not to the ability of those models to represent meaning.

Edit: OK, I don't think I understand what you, er, mean. I think you're saying that language models essentially have a kind of understanding of language, and not just the ability to reproduce it without understanding it. Is that what you are saying?

[ Parent | on HN ]