Re:Wikipedia's in Trouble (2019)
by indymike on Friday December 04, 2020 @10:53AM
(#25303682)
This is exactly what I was thinking. Wikipedia articles carry semantic data (ld-json), so it should be pretty easy to just scrape away.
[ Parent
| on HN ]
The LD-JSON data is quite limited. I looked at this page
https://en.wikipedia.org/wiki/Thomas_Sowell
I went and used this
https://addons.mozilla.org/en-US/firefox/addon/openlink-stru...
and the JSON-LD data comprised of "wrapper metadata" for the document, a photograph of that person, and a link to a concept in Wikidata where you would find some of the facts that you'd be looking for if you mistook the wikipedia page for the person.
The page at Wikidata for that person
https://www.wikidata.org/wiki/Q553449
has the birth date, gender and other facts such as he taught at both Cornell and Stanford and also links to identifiers for that person in many bibliographic databases.
There's also an alternate html output that has more semantic tags (and the html is consistent enough there are parsers to take this html and turn it back into wikitext): https://en.wikipedia.org/api/rest_v1/page/html/Albert_Einste...