Re:Ask HN: How to implement an NLP grammar parser for a new ...
by curuinor on Monday February 20, 2017 @04:49PM
(#13691269)
word2vec is the latest in a long line of connectionist claims that what we call grammar does not exist. Instead of thinking of a set of deterministic rules, you think of a dynamical system which flays off language as it toddles on.
Also nowdays, word2vec is unrelated to the understanding of grammatical constructs in natural languages. It's simply said a coincidence or co-occurance of words. Grammartical interpretation of a sentence must be seens as a general graph whereas word2vec operate on the linear structure of sentences (one word after the other). If word2vec had to work on grammatical constructs it should be able to ingest graph data. word2vec works on matrices where the graphical representation of the grammar of sentence (POS tagging, dependencies, anaphora, probably others) is graph otherwise said a sparse matrix or a matrix with a big number of dimensions. (It seems to me machine learning is always about dimension reduction with some noise).
I am quite ignorant about the literature on the subject of machine learning operated to/from graphical datastructures.