Re:Finnish breaks natural language processors
by yorwba on Friday March 01, 2019 @06:04PM
(#19286174)
If I do echo "忘れちゃった" | mecab, I get
So MeCab most definitely knows about that grammar. It's special-cased even! Admittedly, the way った is split off as a separate suffix is a bit ugly.
[ Parent
| on HN ]
Re:Finnish breaks natural language processors
by Grue3 on Saturday March 02, 2019 @03:07AM
(#19288203)
That's the thing though, 忘れちゃ is a completely different, unrelated form that means 忘れて+は. So yes, this split is in fact incorrect and if it wasn't past tense, but dictionary form 忘れちゃう, the result would be even worse with う being split off as "rain"? or something.