News for hackers. Stuff that matters.
Re:AMD acquires Taalas to boost inference performance by etc... by pastel8739 on Friday August 07, 2026 @12:02AM (#49205783)
This is the same pitch that people make about AI today. Speed isn’t the differentiator, quality is
Re:AMD acquires Taalas to boost inference performance by etc... by Certhas on Friday August 07, 2026 @01:35AM (#49206241)
So for every work produced by AI have ten separate agents review it thoroughly.
Re:AMD acquires Taalas to boost inference performance by etc... by sroerick on Friday August 07, 2026 @02:54AM (#49206813)
They are both the differentiator.

AI previously provided speed but not quality. As soon as quality reached an acceptable threshold, the speed became the reigning factor.

In my opinion the quality is still much lower, but speed means the cost is significantly lower also.

Re:AMD acquires Taalas to boost inference performance by etc... by TeMPOraL on Friday August 07, 2026 @04:11AM (#49207322)
AI is already fast enough that human is a bottleneck. Hell, typing speed became a bottleneck like it was never before.

I mean, if an agent can do half-decent work in less time than it takes the user to prompt them (and "user" in this context is a fast touch-typist like most programmers are), it's obvious it's not the agent that's the bottleneck anymore.

Re:AMD acquires Taalas to boost inference performance by etc... by tripzilch on Friday August 07, 2026 @07:04AM (#49208568)
Because finishing someone else's (or something else's) "half decent work" to the point of "actually decent" becomes the bottleneck.

This has always been the case for human project management, and LLMs just aren't at that level yet.

It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough. And for sure, newer models of LLM seem to be getting better at that.

Re:AMD acquires Taalas to boost inference performance by etc... by TeMPOraL on Friday August 07, 2026 @05:59PM (#49216724)
> It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough.

But that's what Agile is all about, isn't it? We've been speedrunning delivering increasingly smelly shit at increased velocity ever since SaaS became a thing, because ubiquitous Internet access is what allowed our industry to adopt the "lob feces over the fence for users to deal with" release model.

AI does speed that up, true (though since the market - and management - didn't catch up with it yet, we have a brief moment where we can use AI to increase quality while keeping usual delivery rate.)

Re:AMD acquires Taalas to boost inference performance by etc... by tiborsaas on Friday August 07, 2026 @06:44AM (#49208412)
Speed will be one of the killer features once you get closer to instant speeds of 300ms. Just remember what changes were made possible simply by upgrading from ADSL to broadband.

If inference speed goes up, I can launch the same query 5 times, evaluate the best result and proceed from there. Of course, evaluation is also instant, so in seconds I can get a near perfect solution. Or maybe 10 and I can pick what I like the best.