Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by jazzyjackson on Sunday May 17, 2026 @12:16PM
(#48170264)
I haven't been following anyone baking models into ASICs, is it not still necessary to pack just as many transistors onto a chip, whether it's an NPU or GPU, ASIC or not you still need to hold hundreds of gigabytes in memory, so how is it cheaper to bake it onto custom silicon than running it on commodity VRAM? (Asking because I don't know!)
[ Parent
| on HN ]
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by lumost on Sunday May 17, 2026 @01:34PM
(#48171069)
Not my area either! But my understanding is that there are more efficient methods of representing static numbers when you can skip the vram lookup.
Is an example startup in this area claiming 16k tok/s on an asic for llama 8b. Qwen has a 27b model at opus 4.5 quality.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise
by jazzyjackson on Sunday May 17, 2026 @02:06PM
(#48171485)
Neat, thanks for the link