Re:TSMC warns AI chip crunch will last another 18 months
by SilverBirch on Friday September 08, 2023 @02:44PM
(#37437674)
The problem is the bull whip effect. Yes there’s loads of demand now, but are we really saying that the AI boom is a permanent uptick in demand for silicon, or is it more likely that the hype dies down? By the time capacity comes online demand may well gave peaked and dropped. Suddenly these massive sunk cost fabs will be taking any business they can to amortise the costs.
Re:TSMC warns AI chip crunch will last another 18 months
by ethbr1 on Friday September 08, 2023 @05:00PM
(#37439358)
It seems more likely that efficiency gains decrease aggregate compute requirements than people stop using AI tools altogether.
At minimum, LLMs work as a better human-software interface medium, which means they're going to be infused in almost everything non-technical consumer-facing.
Even absent any other breakthroughs, that seems like a huge consumer of AI hardware capacity.
Also I don't think manufacturing cost is the biggest of issue, because the margins are significantly higher than consumer GPUs which are in oversupply now for Nvidia. It's that Nvidia has to commit years in advance for the capacity.