News for hackers. Stuff that matters.
Re:Getting Started in Natural Language Processing by yorwba on Friday June 08, 2018 @01:27PM (#17267718)
> They train DL models on labeled data without knowing anything about syntax trees, and allow NN do all the magic.

Sure, but that doesn't mean that knowing about syntax won't improve the result. If you're training a translation model on a huge database of labeled examples, it might discover syntactic relationships from scratch. But if you don't have so much data, you're probably better off using all the auxiliary information you can get.

Re:Getting Started in Natural Language Processing by riku_iki on Friday June 08, 2018 @01:58PM (#17268034)
> But that doesn't mean that knowing about syntax won't improve the result

this is likely correct, additional high quality input will likely improve performance, but creating such input for 200 modern human languages requires significant effort, much larger than allowing NN to solve this problem, that's why researchers invest this effort into NN improvement, not syntax tree creation tooling.

Re:Getting Started in Natural Language Processing by hcorreasuarez on Friday June 08, 2018 @02:59PM (#17268645)
All of us have to strike the right balance between stubbornly believing that NNs will solve all problems in NLP -which, imho, underestimates what linguistics can do for this field of study- and stubbornly saying that only linguistic knowledge will lead to an improvement of the results -which, imho, means underestimating the outstanding work on deep learning techniques done so far. As you said, creating high-quality input is likely to be costly -and I'm not talking about syntax tree creation tooling only here. But, isn't it worth the while? I believe it is.