News for hackers. Stuff that matters.
Re:AMD acquires Taalas to boost inference performance by etc... by Gigachad on Thursday August 06, 2026 @07:09PM (#49203875)
It costs something like $300,000 for the hardware to run a model of that size. You'd pay that for a single model for 1-2 years? Not even the AI companies can justify that kind of spend which is why they keep extending the expected lifespan on their hardware in the accounting.
Re:AMD acquires Taalas to boost inference performance by etc... by zxspectrum1982 on Thursday August 06, 2026 @07:11PM (#49203892)
I'm expecting the Taalas MSIC version to cost a fraction of that. Then probably have some kind of cheap subscription to Anthropic for updates (yes, Taalas chips can receive a certain kind of updates: they have a small SRAM).
Re:AMD acquires Taalas to boost inference performance by etc... by mdp2021 on Thursday August 06, 2026 @08:03PM (#49204342)
> It costs something like $300,000 for the hardware to run a model of that size

You did not compute that as the cost for a speculative card from Taalas, right?

Re:AMD acquires Taalas to boost inference performance by etc... by Gigachad on Thursday August 06, 2026 @09:10PM (#49204739)
It's the cost of the current nvidia hardware used to run these models. Of course all bets are off if you are accounting for some future chip that doesn't exist yet which could cost less.
Re:AMD acquires Taalas to boost inference performance by etc... by lsaferite on Monday August 10, 2026 @03:10PM (#49248261)
Given the fact that Taalas was claiming 1/10th the hardware cost and 1/10th the power consumption, yeah, companies would absolutely jump at that. Now, whether they can achieve that in practice is yet to be seen.