News for hackers. Stuff that matters.
Re:Ask HN: How to implement an NLP grammar parser for a new ... by Eridrus on Monday February 20, 2017 @10:33AM (#13688066)
Not an expert in NLP, but my understanding is that many models are at least partly statistical these days so you will probably need a set of labeled data.

First you should figure out what type of parsing you want. I would recommend looking at Stanford's CoreNLP library to see which task you actually want. There are multiple ways to parse grammar. Once you can name the actual problem you want to solve it should be googleable.

The downside of classical NLP is that you need to learn some amount of linguistics to create labeled parse trees for your data or even interpret them.

So, if your goal is to build an application, rather than a library, you may want to learn about neural nets/LSTMs. They can let you go from language to the actual information you want without you needing to encode and interpret parse trees.

The downside of neural nets is that they tend to need more data, but the data is much simpler so you could farm this out to mechanical turk if you wanted.

Re:Ask HN: How to implement an NLP grammar parser for a new ... by karambahh on Monday February 20, 2017 @10:38AM (#13688118)
A pointer of potential data

Cotterell, R., & Callison-Burch, C. (2014). A Multi-Dialect, Multi-Genre Corpus of Informal Written Arabic. In LREC (pp. 241-245).

http://www.lrec-conf.org/proceedings/lrec2014/pdf/641_Paper....

It's using arabic characters but at least it's labelled data of Magrhebi arabic. So you'd "only" have to perform a translitteration or multiple translitteration between that corpus and your data.