Re:Wikipedia is now drawing facts from the Wikidata repository
by eksith on Monday April 29, 2013 @03:45PM
(#5628230)
Good resource! And I think your idea of linking to the disambiguation page makes sense, but there may be a way to infer the correct article from the list of links based on the context of the text in the linking article.
Re:Wikipedia is now drawing facts from the Wikidata repository
by mindcrime on Monday April 29, 2013 @03:51PM
(#5628265)
Yeah, there's that as well.
Also, if you're interested in that sort of thing, two other projects you might find interest are:
and
Both involve extracting semantic meaning from unstructured data. It's pretty cool stuff.
http://semantic-mediawiki.org/wiki/Help:Introduction_to_Sema...
If not, doing that should be possible using an NLP library that does NER. Along with heuristics, one could use the list of currently existing articles as a seed.
Edit: Of course, if all you're trying to do is link to existing pages, then you don't use the set of existing pages as a seed, you just use them as the list. But if you're trying to extract "entities" that don't have WP pages yet, then you'd still want to fall back to other NER techniques, which include various heuristics and what-not. Whether or not there would be an value in that is an open question, I suppose.