Re:Introducing Streaming K-Means in Spark MLlib 1.2
by michaelmior on Wednesday January 28, 2015 @03:55PM
(#8962495)
I understand that's a drawback of k-means. I was just wondering if this was something that Spark solved natively. Looks like the answer is no for the time being. Thanks for the pointer to LWPR :)
Re:Introducing Streaming K-Means in Spark MLlib 1.2
by rxin on Wednesday January 28, 2015 @03:58PM
(#8962508)
Maybe using BP-Means: http://arxiv.org/abs/1212.2126
K-Means without preset K.
You could do that here too, just have a range of k. If only there were a streaming leave-one-out cross validation for k-means to complement this approach ...
(it is possible to do this in a streaming style, see LWPR)