Re:TSMC and Graphcore Prepare for AI Acceleration on 3nm
by ben_w on Thursday August 27, 2020 @04:05PM
(#24298035)
For what an anecdote is worth, even back in the ‘90s my dad was telling me how the speed of light dictated the shape of supercomputers.
[ Parent
| on HN ]
Re:TSMC and Graphcore Prepare for AI Acceleration on 3nm
by dekhn on Thursday August 27, 2020 @04:09PM
(#24298082)
It was far worse then, as copper places serious upper limits on long-distance high-speed transport. Data transmission latency of copper tends to be 2X that of light (physical bounds, not empirically observed), and making very long cables with copper is impractical due to signal losses. Once long fiber was cheaply available people started to use that for the long links (imagine a toroidal mesh with wrap-around links- the wrap-around links are very long (100+m) and need to be fiber).
However, long fiber causes latency problems- those wrap around links will slow do any global reductions you need to do.