Show HN: Franc – Detect natural languages

Re:Show HN: Franc – Detect natural languages by allan_s on Friday October 03, 2014 @09:32AM (#8405431)

for the case of "one sentence detection" you can use Tatoeba project database dump http://tatoeba.org/eng/downloads

you have a CSV of iso code => sentence , which should be 99% accurate (as it gets user proofed), so on in which you can compare your tool with.

I think for longer text one could use Wikipedia dump or alike ?

[ Parent | on HN ]

Re:Show HN: Franc – Detect natural languages by michaelmior on Friday October 03, 2014 @09:56AM (#8405536)

Thanks for the pointer. I might decide to whip something up one of these days. I really have no need for language detection, but I just find it interesting and I'm curious to see wich libraries will win out.

[ Parent | on HN ]