Re:Jim Keller moves to AI chip startup
by vnorilo on Wednesday January 06, 2021 @03:53AM
(#25655874)
Thanks for these! My assumption is that hiring Keller means they plan to gain advantage by world class execution rather than some crazy architectural leap of faith.
Re:Jim Keller moves to AI chip startup
by andy_ppp on Wednesday January 06, 2021 @04:24AM
(#25656032)
Watching the video I think turning each tensor into packets is quite clever as you get some ability to send them around a network and organise layers/data manipulation/transforming the layers/compression all as part of the stack.
I’m pretty surprised no-one has actually exposed the actor model for parallelising neural networks, it seems it would work quite well and allow you to have a layer per node (or actually many split configurations). Maybe data locality would be an issue with actor based approaches. They seem to be solving this at a lower level but with less knowledge of the actual parallelism in software.
I don't notice anything in particular that stands out vs. the many other AI chips people are making, at first glance. But I'm far from an expert. There are several other technical videos on their YouTube channel as well: https://www.youtube.com/channel/UC7041p6DlAh0r4_Fnlk10pQ