Re:AMD acquires Taalas to boost inference performance by etc...
by bastawhiz on Thursday August 06, 2026 @06:39PM
(#49203604)
The weights might fit in cache, if you're using a small model. If you wanted to have a 20B+ parameter model, that's just going in RAM. You could put more RAM in the device and pay the perf cost or have a dedicated chip. Most devices already have a dedicated chip, this just changes which silicon you're spending the money on.
[ Parent
| on HN ]