Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by nixon_why69 on Sunday May 17, 2026 @12:07PM
(#48170153)
Why not have a bunch of SRAM and various operations like "Q4 matmul" in silicon? Model weights and even architectures could still evolve on a platform like that.
[ Parent
| on HN ]
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by ac29 on Sunday May 17, 2026 @12:56PM
(#48170664)
Doesnt "a bunch of SRAM" top out at maybe a few gigs per chip (with zero area used for logic)? You'd need an order of magnitude more to fit even a fairly weak general purpose LLM model.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by throwa356262 on Sunday May 17, 2026 @12:57PM
(#48170673)
I belive that is what NPUs are.
The issue is the very huge amount of DRAM and high bandwidth these model require.