News for hackers. Stuff that matters.
Re:AMD acquires Taalas to boost inference performance by etc... by lelanthran on Friday August 07, 2026 @02:03AM (#49206422)
Did you try using the the talaas chat? Something stupid like 18k tokens/second.

Think it's called Askjimmy or similar.

Re:AMD acquires Taalas to boost inference performance by etc... by TeMPOraL on Friday August 07, 2026 @03:52AM (#49207203)
What is the model they're using there though? Interrogated, it claims it's a BERT variant and has capabilities around GPT-3 and below GPT-4.

(Not that I believe it, it writes too well for GPT-3.)

Hosted frontier models from two years ago would be much faster today, too.

Re:AMD acquires Taalas to boost inference performance by etc... by egorfine on Friday August 07, 2026 @04:18AM (#49207373)
They run Llama 3.1 8B.
Re:AMD acquires Taalas to boost inference performance by etc... by jgilias on Friday August 07, 2026 @02:16AM (#49206536)
Oh boy, thanks for sharing this, truly mind blowing. It was chatjimmy.ai