Re:Amazon spends another $2.7B on Anthropic
by jedberg on Wednesday March 27, 2024 @01:39PM
(#39842224)
> Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet???
Amazon has had its own chips for years. They bought a company called Annapurna Labs in 2015, who made the chips[0].
https://aws.amazon.com/machine-learning/inferentia/
Re:Amazon spends another $2.7B on Anthropic
by VirusNewbie on Wednesday March 27, 2024 @01:58PM
(#39842474)
Ah, thanks for the correction, I wasn't aware.
I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
Re:Amazon spends another $2.7B on Anthropic
by jedberg on Wednesday March 27, 2024 @02:48PM
(#39843086)
I'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
Re:Amazon spends another $2.7B on Anthropic
by VirusNewbie on Wednesday March 27, 2024 @04:37PM
(#39844305)
Yeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.
Re:Amazon spends another $2.7B on Anthropic
by Bellyache5 on Wednesday March 27, 2024 @01:19PM
(#39841937)
No idea if it's any good or not, but Amazon has their own "Inferentia" chips.
Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet???
So I wonder how these deals are structured? Does amazon have to supply a custom AI chip that beats some benchmark? Would be pretty great if that part of the deal to use their chips involved beating TPUs, and if somehow Google's TPUs continue improving, they don't have to switch.
All in all, I'm very impressed with Anthropic as a company. I think they're the new OpenAI.