Re:Marc Andreessen on the atomization of AI
by radarsat1 on Wednesday September 14, 2016 @09:00AM
(#12496374)
> Vanilla deep learning is so far ahead of what most companies use for analytics, that very little research is needed to offer a product with significant advantages over what's in practice now
But by "vanilla deep learning", I think you are referring to this vs research into new models and algorithms. I think "research" in the context of "research-heavy start-ups" is not about new algorithms, but about finding ways to use even "vanilla deep learning" on their available datasets. Quite a lot of papers at conferences, for example, are not about new algorithms, but about new ways to use old algorithms.
I disagree with Andreessen that Google's Tensorflow propaganda on Udacity is "opening the kimono" or having a large effect on AI. TF isn't better than pre-existing tools in many ways. And the ways that Google uses it aren't really transferable in an online course, since Google does have the data, architectures, infrastructure and talent -- some of which it can't share by definition, and some of which it won't share, for obvious reasons.
The smartest startups outsource research to universities and government funded bodies. It's a way of derisking themselves as investments. That's no different for AI. Theoretical research and product development are almost (but not quite) totally different things. Which is something that graduate students who think they want to do a startup should remember, because if they love research, they probably won't have much time for it.
[Disclosure: I'm associated with a rival DL library that I won't plug here.]