News for hackers. Stuff that matters.
Re:Finnish breaks natural language processors by gizmo686 on Friday March 01, 2019 @08:59AM (#19280625)
But Japanese is not written as character soup. It mixes two (actually 3) types of characters, with the "grammatical" sounds being written in hiragana and most content sounds being written in kanji. Since the grammatical sounds are a closed class, and tend to occur at word boundries, it turns out to be relativly simple to seperate words.

There are no comments on this comment yet.