News for hackers. Stuff that matters.

A comment on Data-Mining Wikipedia for Fun and Profit. Parent comment

Re:Data-Mining Wikipedia for Fun and Profit by michaelbuckbee on Thursday August 19, 2021 @11:10AM (#28234828)
That's part of it, but also it's typically much more difficult and there's an element of "why are you making this so much harder on yourself".
[ Parent | on HN ]
Re:Data-Mining Wikipedia for Fun and Profit by billpg on Thursday August 19, 2021 @11:15AM (#28234911)
(Author of original article here.)

That's the great thing about HtmlAgilityPack, extracting data from HTML is really easy. I might even say even easier than if I had the page in some table-based data system.

[ Parent | on HN ]
Re:Data-Mining Wikipedia for Fun and Profit by SlimyHog on Thursday August 19, 2021 @11:19AM (#28234969)
The HTML is more volatile and subject to change than other sources though
[ Parent | on HN ]
Re:Data-Mining Wikipedia for Fun and Profit by FalconSensei on Thursday August 19, 2021 @12:32PM (#28235923)
Don't remember the last time wikipedia changed the infobox though
[ Parent | on HN ]
Re:Data-Mining Wikipedia for Fun and Profit by jcun4128 on Thursday August 19, 2021 @11:55AM (#28235438)
Can make it even harder, use Puppeteer to take screenshots then pass it to an OCR to get the text.
[ Parent | on HN ]
Re:Data-Mining Wikipedia for Fun and Profit by thechao on Thursday August 19, 2021 @12:56PM (#28236273)
https://xkcd.com/378/
[ Parent | on HN ]