News for hackers. Stuff that matters.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by nixon_why69 on Sunday May 17, 2026 @12:07PM (#48170153)
Why not have a bunch of SRAM and various operations like "Q4 matmul" in silicon? Model weights and even architectures could still evolve on a platform like that.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by ac29 on Sunday May 17, 2026 @12:56PM (#48170664)
Doesnt "a bunch of SRAM" top out at maybe a few gigs per chip (with zero area used for logic)? You'd need an order of magnitude more to fit even a fairly weak general purpose LLM model.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by throwa356262 on Sunday May 17, 2026 @12:57PM (#48170673)
I belive that is what NPUs are.

The issue is the very huge amount of DRAM and high bandwidth these model require.