Re:Amazon spends another $2.7B on Anthropic
by VirusNewbie on Wednesday March 27, 2024 @01:58PM
(#39842474)
Ah, thanks for the correction, I wasn't aware.
I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
Re:Amazon spends another $2.7B on Anthropic
by jedberg on Wednesday March 27, 2024 @02:48PM
(#39843086)
I'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
Re:Amazon spends another $2.7B on Anthropic
by VirusNewbie on Wednesday March 27, 2024 @04:37PM
(#39844305)
Yeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.
Amazon has had its own chips for years. They bought a company called Annapurna Labs in 2015, who made the chips[0].
https://aws.amazon.com/machine-learning/inferentia/
https://aws.amazon.com/machine-learning/trainium/
[0] https://en.wikipedia.org/wiki/Annapurna_Labs