Re:AMD acquires Taalas to boost inference performance by etc...
by trebligdivad on Thursday August 06, 2026 @08:46PM
(#49204604)
What, even if it means you can run models without relying on the currently backlogged DRAM production?
[ Parent
| on HN ]
Re:AMD acquires Taalas to boost inference performance by etc...
by adgjlsfhk1 on Thursday August 06, 2026 @10:18PM
(#49205227)
The size of model we're talking about running doesn't need much if any dram.
Re:AMD acquires Taalas to boost inference performance by etc...
by trollbridge on Friday August 07, 2026 @03:16AM
(#49206952)
The chatjimmy demo is using a model that needs 6-18GB of VRAM. That's not exactly trivial.
I could see it being feasible to get a Qwen-3.6-27b type of model done on something like this. Qwen-3.6-27b at 18tok/s would be a game changer.
Re:AMD acquires Taalas to boost inference performance by etc...
by adgjlsfhk1 on Friday August 07, 2026 @08:34AM
(#49209443)
right, but that's a reticle size chip. to put something in a phone it has to be ~10-30x smaller