Re:AMD acquires Taalas to boost inference performance by etc...
by intrasight on Thursday August 06, 2026 @08:23PM
(#49204465)
Box that plugs into my desktop would be fine. Or perhaps in SSF form factor.
Re:AMD acquires Taalas to boost inference performance by etc...
by manmal on Friday August 07, 2026 @01:45AM
(#49206295)
> At a certain speed point, you're able to move from request -> response to a cascade of tool calling and "subagents"
That also needs server class hardware though. A phone won’t happily service the insane amount of IO, compute, and network that this cascade would require.
But if the basic premise of "good enough LLM at insane throughput" holds, I think it could qualitatively change local uses of LLMs. At a certain speed point, you're able to move from request -> response to a cascade of tool calling and "subagents", which could allow a small model to be much more useful, if provided with a lot of local data and tool calls.
That said, this is assuming you could stuff a "good enough" model into a phone with Taalas-like technology. The Taalas tech demo was an 8B parameter model and required hundreds of watts (IIRC) to run. The efficiency was good given the speed (as I understand), but it's not clear at all that the approach scales small enough to be a sensible coprocessor on an iPhone or whatever.