News for hackers. Stuff that matters.
Re:NLP Challenge: Find semantically related terms over a lar... by elblanco on Friday November 05, 2010 @11:00PM (#1875771)
> What is a semantically related word?

Right, I was going to say, just get a dump of wordnet and build a thesaurus graph...

Re:NLP Challenge: Find semantically related terms over a lar... by rarestblog on Saturday November 06, 2010 @01:17AM (#1876171)
I think the challenge implies that the only data you can use is the provided dataset. Otherwise it's just make no sense - if you pull the similarity data from other place - then where's the challenge?
Re:NLP Challenge: Find semantically related terms over a lar... by elblanco on Saturday November 06, 2010 @09:59AM (#1876883)
That's why I'm confused.

Somebody else in this thread brought up performing some kind of k-gram analysis and building a "thesaurus" of sorts from that. While that can be really good for vector space style document matching, if you try and actually "read" the results, you can get some weirdness.

  The duck died.
  The car died.
Ergo duck <semantically equivalent> car.