Re:Cerebras Systems unveils a 1.2T transistor chip for AI
by mkl on Monday August 19, 2019 @08:37PM
(#20742940)
Those aren't neurons, though. Biology is different, synaptic connections have to physically fit, etc. Individual neurons serve multiple purposes, but I don't think we know if their speed is a limiting factor in that.
Absolutely. In fact, we do: in batched processing (pervasive in deep learning today), CNNs and other weight sharing schemes (e.g. transformers) the same "neurons" get re-used many times.