futureishere

That is one really cool application of LDA!

I am so curious about your implementation, for instance, what sort of preprocessing did you have to carry out? I had written a script sometime back to analyze Paul Graham's essays (link: https://github.com/futureUnsure/pg-essay-lda), and had to remove date and times because they appeared a lot and distorted the top topics. I'm wondering if you had to do something similar for text that described code?

Also, did you write an LDA library yourself or did you leverage an existing library?

I apologize in advance if my questions sound naive/stupid, am just a noob...

So, I guess the post has been sort of banned from HN as I cannot see it either on Hacker News trending/new/show pages. It was trending on the front page for quite some time, just sometime ago (so obviously it wasn't downvoted into oblivion). I guess I will have to live with that :(

No worries, I totally understand :-)

I totally agree with your view!

Hey! I am sorry if I rubbed you the wrong way. It was definitely not my intention to eulogize Paul Graham unnecessarily. I wrote that out of sincerity, I genuinely feel that his essays have been highly educational for me, and for a lot of my friends as well. Maybe his essays have not had the same effect on you, and a lot of other people. I guess if enough people complain about it, I'd edit that line out of the README, no questions asked.

I'd also like to add that I mentioned, "one of the.." and "pundit[s]" implying that there are many others who'd be in the club, and Paul Graham isn't the only or most influential. Hope that helps!

That's a really good point! No, I did not, although in hindsight I should have had thought about that. As I had mentioned in the README, the modeling perhaps is not very high quality, but I surely do hope to make it better once I get some free time. Thanks for your suggestion! Means a lot :-)