News for hackers. Stuff that matters.

A comment on WikipediaQL: Query language for efficient data extraction from Wikipedia (early. Parent comment

Re:WikipediaQL: Query language for efficient data extraction... by IfOnlyYouKnew on Tuesday July 06, 2021 @04:42AM (#27745646)
Yes and no. You can get SQL dumps (although XML is more common), but it doesn't contain any useful structure. The article content is just wikitext, and only metadata such as revisions are structured.

You can get a lot of data from Wikidata. They have a SPARQL interface at https://query.wikidata.org/#%23Humans%20born%20in%20New%20Yo... and you can also get all the data in a variety of rdf formats.

[ Parent | on HN ]
Re:WikipediaQL: Query language for efficient data extraction... by arthurcolle on Wednesday July 07, 2021 @10:26AM (#27761488)
You can get all the edges (links between pages) and nodes (pages and text therein), so not sure what you mean about structure. I loaded all of Wikipedia into Neo4J like 6 months ago... Wasn't very hard.
[ Parent | on HN ]