News for hackers. Stuff that matters.
Re:Python NLTK Bayesian Classifier for word sense disambigua... by tkahnoski on Tuesday November 30, 2010 @06:16PM (#1956002)
This is an interesting exercise in building a very specific word disambiguator ('apple' the company vs 'apple' the fruit).

It is a testmanet to NLTK that this can be accomplished in less than 100 lines.

Re:Python NLTK Bayesian Classifier for word sense disambigua... by danieldk on Wednesday December 01, 2010 @05:02AM (#1957403)
Maybe apart from stemming), it's not hard to implement this in ~100 lines without NLTK.:

- In naive Bayes classification, model parameters can usually be estimated using relative frequencies in the training data.

- WordPunctTokenizer is a very simple tokenizer that makes anything matching \w+ and [^\w\s]+ a separate token.

- Extracting Bigrams from a list of tokens is trivial.

Of course, using NLTK will be very helpful in many situations, but this is hardly a testament to NLTK.