News for hackers. Stuff that matters.
Re:AMD acquires Taalas to boost inference performance by etc... by bradfa on Thursday August 06, 2026 @06:11PM (#49203321)
A small model would be. I think that’s more the point. It’s definitely not SOTA but it’s fast and energy efficient and local.
Re:AMD acquires Taalas to boost inference performance by etc... by mdp2021 on Thursday August 06, 2026 @06:27PM (#49203496)
> A small model would be [mobile size]

A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?

Re:AMD acquires Taalas to boost inference performance by etc... by teaearlgraycold on Thursday August 06, 2026 @06:37PM (#49203593)
Is that analogue or are they baking floating points into the silicon?
Re:AMD acquires Taalas to boost inference performance by etc... by AlotOfReading on Thursday August 06, 2026 @08:20PM (#49204444)
It's entirely possible they're using something like block floating point, where most of the hardware is simply fixed point. AMD's NPU does this, for example.
Re:AMD acquires Taalas to boost inference performance by etc... by wmf on Thursday August 06, 2026 @06:31PM (#49203526)
Nope, a small model would be larger than the whole iPhone SoC.