News for hackers. Stuff that matters.
Re:NLP Challenge: Find semantically related terms over a lar... by bravura on Saturday November 06, 2010 @03:35AM (#1876418)
Now, what is the point in trying to generate any kind of "meaning" from those documents if each document consists of completely meaningless gibberish?

A lot of data with a small amount of noise can be much more informative than a small amount of "perfect" data.

If 1-5% of your examples are noise, you can still extract meaning, and find patterns.

Also, that's not meaningless gibberish, there is still signal in those examples.

There are no comments on this comment yet.