News for hackers. Stuff that matters.

A comment on Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language. Parent comment

Re:Critical Behavior from Deep Dynamics: A Hidden Dimension ... by slashcom on Wednesday July 13, 2016 @10:40AM (#12086464)
Forgive me, but I'm less impressed by the paper. As far as I can tell, they've only really shown that (1) language is recursive, which we know already; (2) markov models cannot capture recursive languages, which we've known; and (3) RNNs can, which we've known. But so can PCFGs and many other formalisms from the past 25 years, which they ignore.

I did not read it very closely though.

[ Parent | on HN ]
Re:Critical Behavior from Deep Dynamics: A Hidden Dimension ... by evanb on Wednesday July 13, 2016 @11:56AM (#12087186)
From the article:

> We can formalize the above considerations by giving rules for a toy language L over an alphabet A. In the parlance of theoretical linguistics, our language is generated by a stochastic or probabilistic context-free grammar (PCFG) [41–44]. We will discuss the relationship between our model and a generic PCFG in Section C.

[ Parent | on HN ]