News for hackers. Stuff that matters.

A comment on Japanese Grammar in EBNF notation. Parent comment

Re:Japanese Grammar in EBNF notation by akeruu on Sunday January 05, 2020 @06:02AM (#21960709)
There are but I could not find many details about them in English. Some of the well knowns are:

すもももももももものうち or ははははははははのははははははとわらった

Please see MeCab (https://en.wikipedia.org/wiki/MeCab) segmentation output below:

http://www.edrdg.org/~jwb/cgi-bin/mecabdisp?sent=%E3%81%99%E...

http://www.edrdg.org/~jwb/cgi-bin/mecabdisp?sent=%E3%81%AF%E...

[ Parent | on HN ]
Re:Japanese Grammar in EBNF notation by glandium on Sunday January 05, 2020 @09:01AM (#21961263)
Mecab fails miserably on the second. It doesn't find the hidden "母は", but it's hard to blame it.
[ Parent | on HN ]