News for hackers. Stuff that matters.
Re:Ask HN: Has anyone had luck using the Wikipedia data dumps? by mooss on Saturday March 16, 2019 @07:07AM (#19407262)
I've had some success using this tutorial: https://www.kdnuggets.com/2017/11/building-wikipedia-text-co... .

And I've changed it a little bit to extract only the first n characters, this might be of some use since wikipedia dump are supposed to be pretty large: https://github.com/mooss/ruskea/blob/master/make_wiki_corpus... .

There are no comments on this comment yet.