Re:TSMC starts volume production of 3nm chips
by zozbot234 on Thursday December 29, 2022 @06:06PM
(#34179334)
You mean moving memory closer to compute. And that's happening already in lots of places, even though it brings increased complexity due to having to account for NUMA.
[ Parent
| on HN ]
Re:TSMC starts volume production of 3nm chips
by visarga on Friday December 30, 2022 @11:59AM
(#34186929)
I am thinking long term, as neural nets scale up, we'll have to move compute into memory. The other way around is problematic, small caches don't work well with neural nets. In fact the fastest Transformer (FlashTransformer) is based on principled usage of the SRAM cache because that's the bottleneck.