News for hackers. Stuff that matters.

A comment on Announcing SyntaxNet: The World’s Most Accurate Natural Language Parser. Parent comment

Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by nostrademons on Thursday May 12, 2016 @06:53PM (#11687427)
I was actually pretty disappointed with the NER in CoreNLP - I fed a few articles (including this one) into it, and while it's impressive that a computer can do this at all, it's pretty far away from being able to build a usable product. It seems to over-recognize Persons, for example - Parsey McParseFace was tagged as a person, as were Alice and Bob, as was Tesla (in another article), and while all of these are understandable, they weren't the intended meanings in the articles. I was also pretty disappointed with the date parser: while it gets some tricky ones like "Today" and "7 hours ago", it misses very common abbreviations like 7m or 7min or even "7min ago".
[ Parent | on HN ]
Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by nl on Thursday May 12, 2016 @08:45PM (#11687864)
The state of NLP tools generally is much lower than most people think. People think it is much easier than it is.

For the date parser you want http://nlp.stanford.edu/software/sutime.html

The code and rules aren't fun to customize though.

[ Parent | on HN ]
Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by nostrademons on Thursday May 12, 2016 @09:25PM (#11688028)
Yeah, I looked at SuTime, but it fell down on many common cases (the CoreNLP online demo is actually integrating SuTime into the annotations it produces).

Another option is Natty [1], but it also seems to fail on the same examples. Natty at least has an ANTLR grammar that's reasonably easy to understand, though.

[1] http://natty.joestelmach.com/

[ Parent | on HN ]
Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by nl on Friday May 13, 2016 @12:44AM (#11688681)
I know of one large group that switched (from Timen[1]) to Heideltime[2] because of multi-language support.

One day someone will build a neural net model to do this rather than hand written rules.

[1] https://github.com/leondz/timen

[2] https://github.com/HeidelTime/heideltime

[ Parent | on HN ]
Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by TeMPOraL on Friday May 13, 2016 @05:21AM (#11689411)
Thanks 'nl, 'nostrademons and 'rcpt for the links! I've been using Chronicity[0] in my project, and I hand-hacked a Polish-to-English regexp "translator" to make it work with Polish language[1]. I'll be looking at the sources of the libraries you provided as well as papers they reference; maybe I'll manage to steal some code :).

[0] - https://github.com/chaitanyagupta/chronicity

[1] - it's surprising how easy is to get 80% there with hacks like these: https://github.com/TeMPOraL/alice/blob/master/language.lisp#...

[ Parent | on HN ]
Re:Announcing SyntaxNet: The World’s Most Accurate Natural L... by rcpt on Thursday May 12, 2016 @10:38PM (#11688269)
Heideltime is the best date tagger I've used. Handles multiple languages better than anything else and fits inside uima

https://github.com/HeidelTime/heideltime

[ Parent | on HN ]