News for hackers. Stuff that matters.
Re:Data-Mining Wikipedia for Fun and Profit by ceejayoz on Thursday August 19, 2021 @12:13PM (#28235675)
The problem lies in parsing them.

Look at the template for a subway line infobox, for example. https://en.wikipedia.org/wiki/Template:Bakerloo_line_RDT

It's a whole little clever language (https://en.wikipedia.org/wiki/Wikipedia:Route_diagram_templa...) for making complex diagrams out of rather simple pictograms (https://commons.wikimedia.org/wiki/Template:Bsicon).

Re:Data-Mining Wikipedia for Fun and Profit by jancsika on Thursday August 19, 2021 @05:17PM (#28239492)
Oh wow.

But every other infobox I've seen has key/value pairs where the key was always a string.

So what's the spec for an info box? Is it simply to have a starting `<table class="hello_i_am_infobox">` and an ending `</table>`?

Re:Data-Mining Wikipedia for Fun and Profit by bawolff on Thursday August 19, 2021 @06:27PM (#28240152)
En wikipedia has some standards. Generally though they are user-created tables and its up to the users to make them consistent (if they so desire). En Wikipedia generally does, but its not exactly a hard garuntee.

If you want machine readable use wikidata (if you hate rdf you can still scrape the html preview of the data)