Re:Algorithmic tagging of Hacker News or any other site
by hnriot on Wednesday May 21, 2014 @01:32PM
(#7779524)
it's hard to imagine someone knowing an LDA without also knowing about TF.IDF (it's a dot product, not a hyphen)
[ Parent
| on HN ]
Re:Algorithmic tagging of Hacker News or any other site
by sprobertson on Wednesday May 21, 2014 @03:46PM
(#7780338)
That and the questionable use of stopwords makes it sound like they're just slapping some marketing on an out-of-the box LDA implementation (not that I blame them, it's a dense algorithm).
Re:Algorithmic tagging of Hacker News or any other site
by GFK_of_xmaspast on Wednesday May 21, 2014 @06:36PM
(#7781164)
The OP is pushing "Algorithmica" whose manifesto is here: http://blog.algorithmia.com/post/75680476188/algorithm-devel...
and this doesn't really strike me as much of a victory for the idea that it's just the implementation of an algorithm being the sticking point in practice.
Re:Algorithmic tagging of Hacker News or any other site
by doppenhe on Wednesday May 21, 2014 @07:16PM
(#7781312)
We are just showing the versatility of the platform through a real world use case. LDA is hard to implement/scale for the untrained same as many other machine learning, optimization, graph traversing,etc algorithms. What we are building is crowd-sourced and generalized API where all these algorithms can be combined and used together to really make any application smarter.
The demo we show here is a version of how we used our platform to generate tags for all entries in our API by combining algorithms that existed already in Algorithmia. (modified for performance over quality due to the volume that HN would bring).
Cheers.
Re:Algorithmic tagging of Hacker News or any other site
by s0x on Thursday May 22, 2014 @12:03AM
(#7782035)
It's only hard because most libriaries I've seen have so little documentation available. It's simple once you understand the library. We need people picking these libraries up, implementing them on weekends on fun projects, documenting their work and code, and publishing it for everyone to learn from.