NLP Challenge: Find semantically related terms over a large vocabulary (1M)?

Re:NLP Challenge: Find semantically related terms over a lar... by bravura on Friday November 05, 2010 @11:56PM (#1875925)

It looks like the sparsity of the matrix is going to be a much bigger challenge than the scale.

Sparsity is good. The sparsity is the only reason that you can keep a matrix with this many dimensions in memory.

I understand about the focus being primarily on the approach, that makes sense; how are you intending to evaluate the results files?

For any submission, I will post for a random subset of vocab words each entry's 10 related terms. I'll then ask people to vote blind.

[ Parent | on HN ]

Re:NLP Challenge: Find semantically related terms over a lar... by rarestblog on Saturday November 06, 2010 @01:53AM (#1876256)

I think the more fair comparison would be to show THE SAME random subset for each entry. I.e. same X words for all result sets.

Otherwise, it might happen that a superior result would just show words that don't even have good results, while an inferior subset would get better covered words.

[ Parent | on HN ]

Re:NLP Challenge: Find semantically related terms over a lar... by bravura on Saturday November 06, 2010 @12:56PM (#1877251)

Yes, it will be the same random subset for all participants. Sorry if that wasn't clear.

[ Parent | on HN ]