Re:Data-Mining Wikipedia for Fun and Profit
by cldellow on Thursday August 19, 2021 @12:18PM
(#28235736)
Even just being able to download a tarball of the HTML of the infoboxes would be really powerful, setting aside the difficulty of, say, translating them into a consistent JSON format.
That plus a few other key things (categories, opening paragraph, redirects, pageview data) enable a lot of powerful analysis.
That actually might be kind of a neat thing to publish. Hmmmm.
Re:Data-Mining Wikipedia for Fun and Profit
by jancsika on Thursday August 19, 2021 @05:19PM
(#28239503)
Better yet-- what is the set of wikipedia articles which have an info box that cannot be sensibly interpreted as key/value pairs where the key is a simple string?
That plus a few other key things (categories, opening paragraph, redirects, pageview data) enable a lot of powerful analysis.
That actually might be kind of a neat thing to publish. Hmmmm.