Re:Moore's Law, AI, and the pace of progress
by nine_k on Sunday December 12, 2021 @03:16AM
(#29527972)
I suppose that in the brain most neurons talk to their relatively close neighbors.
To get something comparable to brain tissue, we need to be able to disperse the computing power and memory across a large number of small nodes. Currently both CPUs and RAM are hyper-centralized.
> assume two iPhones floating in space were simulating two connected neurons, with direct laser links between them. In order for the two to communicate with worse than the 1/200 second latency as neighboring neurons in our brains do...the two phones would need to be over 1000 miles away from each other, about the radius of the moon.
> Thus, for the silicon advantage to start hitting scale out limits relative to what we know is biologically necessary, we would need to be building computers about the size of the moon.