Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by mark_l_watson on Thursday April 20, 2017 @11:05PM
(#14162807)
Amazing not only in the speedup, but also in saving electricity.
Deep learning is changing the field of AI and I expect that with a few more breakthroughs in training algorithms and hardware everything will start to change, hopefully for the better. I wonder when we will see ultra low power neural chips in cellphones.
In the 1980s, my team at SAIC built special purpose neural hardware: Harvard memory architecture designed to run backprop quickly. We got 5 megaflops out of our boards and we were happy enough.
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by highd on Friday April 21, 2017 @01:25AM
(#14163283)
I don't think this will have anything to do with training, since it's the TPU team and trying to beat nVidia at floating-point matrix multiplication doesn't seem like a great idea. Run-time can generally be done with integer operations, which is near dirt-cheap these days - I'd think the only interesting things would be operating at server scales or so low-power that you're getting 30FPS on your classification/segmentation what-have-you on your smartphone without impacting battery life. My guess is the former, though I'm not sure what the market size is for companies that need to evaluate their machine learning systems at speeds fast enough to merit specialized hardware.
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by siculars on Thursday April 20, 2017 @11:25PM
(#14162885)
I don't quite understand how these xooglers can take any of that knowledge with them and start a new company. Wouldn't everything they do be patent encumbered? Sounds like a big fat unknown liability to me. Not to mention non competes. What am I missing?
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by sp0rk on Thursday April 20, 2017 @11:36PM
(#14162928)
I recently read a Vox article that explained how California courts don't enforce contracts that limit employee mobility (and partially explains why behavior like this is possible):
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by tnecniv on Friday April 21, 2017 @12:26AM
(#14163089)
I don't know about non-competes, but you can't patent math. You can patent systems that use math, but not the math itself. If the application is different enough they might be fine?
I'd be interested to hear from somebody who knows more.
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by therein on Thursday April 20, 2017 @11:53PM
(#14162989)
His story hasn't come to an end yet. He will definitely end up losing more than he gained at the end. Google isn't taking this too lightly. They'll make an example out of him.
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by rayuela on Thursday April 20, 2017 @11:38PM
(#14162935)
With Nvidia pretty much a monopoly in the hardware space for deep learning I think there is certainly a lot of room for disruption. Given that they've got 8 out of the first 10 members of the TPU team there might actually be a bit of potential for this venture to succeed. I for one am happy to see some real competition coming to this market.
Re:Ex-Googlers left secretive AI unit to form Groq with Pali...
by jclune on Saturday April 22, 2017 @09:40PM
(#14175951)
A high tech incumbent with a monopoly doesn't scream opportunity to me. This startup is brave AF, but definitely 8/10 from the TPU team have the best shot of anybody.
Deep learning is changing the field of AI and I expect that with a few more breakthroughs in training algorithms and hardware everything will start to change, hopefully for the better. I wonder when we will see ultra low power neural chips in cellphones.
In the 1980s, my team at SAIC built special purpose neural hardware: Harvard memory architecture designed to run backprop quickly. We got 5 megaflops out of our boards and we were happy enough.
http://www.vox.com/new-money/2017/2/13/14580874/google-self-...
I'd be interested to hear from somebody who knows more.
If you call it software you can.
I wonder if the death of Moore's Law finally opens the way for entrants.