Re:Show HN: Clozemaster – Learn language in context
by halfdan on Saturday February 18, 2017 @04:18PM
(#13676744)
This is great. How did you do the frequency groupings for more complex languages like German or Icelandic? Did you use a word stemmer or did you find lists that include noun declensions?
[ Parent
| on HN ]
Re:Show HN: Clozemaster – Learn language in context
by cmmike on Saturday February 18, 2017 @04:39PM
(#13676841)
I'm using lists with declined nouns and conjugated verbs, so you should see the more common declensions/conjugations earlier.
Re:Show HN: Clozemaster – Learn language in context
by halfdan on Saturday February 18, 2017 @05:18PM
(#13677017)
Cool, that makes sense. Are those lists publicly available?
Do you also detect word types? I.e. "Der Mann" (nominative masculine article der) vs. "Das Haus der Frau" (genitive feminine article der) [German] or "að leita að" (infinitive marker að vs. prepositional að) [Icelandic]
Re:Show HN: Clozemaster – Learn language in context
by cmmike on Saturday February 18, 2017 @05:45PM
(#13677118)
Most of the lists come from https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists with some additional processing to try to remove names, places, etc. I still need to make the exact lists Clozemaster is using available on the site somehow.
At the moment Pro users can play sentences grouped by missing word part-of-speech for German, Spanish, French, and Italian from English. I've tried a few different approaches to determining the word types / part-of-speech of words in a given sentence, but none have been super accurate so far. There's definitely a lot more fun/interesting stuff I'd like to do with Clozemaster if I ever do find or develop a good way to detect types.