Re:If You Liked This, Sure to Love That
by FiReaNG3L on Friday November 21, 2008 @11:45PM
(#372713)
I really wish there was an open source incremental SVD-based library to to collaborative filtering; the algorithm is known, we know its pretty efficient, scalable and high performance. Sure there is Mahout (http://lucene.apache.org/mahout/) but development seems pretty slow, if there is still dev work at all on this.
[ Parent
| on HN ]
Lingpipe has a semi-open license, and a Java implementation of incremental SVD. The original incremental SVD code is open: http://www.timelydevelopment.com/demos/NetflixPrize.aspx
BTW, SVD is not scalable. I define scalable algorithms to have time and space complexity O(n log(n)) or less. SVD is generally O(n*n)+, requiring matrix multiplication. You'll have to shard your computations in order to scale indefinitely.