News for hackers. Stuff that matters.
Re:Show HN: Subreddit classifier using scikit-learn and a hi... by ioloop on Monday December 19, 2016 @10:23AM (#13211929)
You are indeed right, and I encourage anyone interested in computing the precision metrics to do so.

The focus of this post is the GoLang proxy used for the caching. It's actually used in a CI / CD environment, but I'm finding it incredibly useful for a whole variety of tasks.

Regarding the precision metrics, you can find all the information required here http://scikit-learn.org/stable/tutorial/text_analytics/worki... to compute the precision.

In the scikit-learn article the classifier scores over 90% precision, so I'd expect it would be possible to do the same.

I'll be posting more about this over the xmas period, so I'll write a part II, where I compute the precision metrics.

Another thing worth noting is that it's not caching the HN comments, while it is using the reddit comments. Despite using tfidf, this still completely skews the results towards reddit as opposed to HN. So that's something else any interested reader can look into.

Thank you for pointing this out.

Re:Show HN: Subreddit classifier using scikit-learn and a hi... by jackschultz on Monday December 19, 2016 @10:29AM (#13211965)
Well sure it's possible, I've done writeups on text classification with Scikit-Learn as well here:

https://bigishdata.com/2016/12/05/classifying-amazon-reviews...

But results and how well the classifier performs really just depends on the quality and amount of training data you have. So would be interesting to see how this does if you can get a bunch more data from each of the subreddits and have some more test examples!

Re:Show HN: Subreddit classifier using scikit-learn and a hi... by ioloop on Monday December 19, 2016 @10:37AM (#13212020)
Thank you Jack. I think your point is important so I'll add a note at the end of the article. I'll also add link to your article as I think it's complimentary.