News for hackers. Stuff that matters.

A comment on Ask HN: Are there any purely keyword-based search engines with no NLP?. Parent comment

Re:Ask HN: Are there any purely keyword-based search engines... by lacksconfidence on Sunday March 25, 2018 @04:14PM (#16674305)
You can get the raw text with wikitext and whatnot removed from the search dumps made every week (also has various other metadata)

http://dumps.wikimedia.your.org/other/cirrussearch/

These are structured with a JSON string for each doc roughly like https://en.m.wikipedia.org/wiki/Foobar?action=cirrusdump

[ Parent | on HN ]

There are no comments on this comment yet.