News for hackers. Stuff that matters.
Re:Opus – an open source parallel corpus by reubenbond on Sunday August 15, 2021 @10:56AM (#28189256)
The Opus OpenSubtitles corpus was very useful when I was creating this Chinese-English dictionary app: https://github.com/ReubenBond/HanBaoBao. The tool which creates the dictionary database aggregates several sources, including processing Chinese subtitles for word frequency to inform the most likely cuts when performing word segmentation.

There are no comments on this comment yet.