At Amazon's Biggest Data Center, Everything Is Supersized for A.I

Re:At Amazon's Biggest Data Center, Everything Is Supersized... by tyingq on Friday July 11, 2025 @07:45AM (#44531033)

"Trainium accelerator" doesn't sound like it would be terribly useful outside it's current niche. It's not clear how much of the spend is that kind of thing versus general purpose compute and storage.

[ Parent | on HN ]

Re:At Amazon's Biggest Data Center, Everything Is Supersized... by coredog64 on Friday July 11, 2025 @06:23PM (#44537364)

For the previous generation, AWS had a split where Trainium == model training and Inferentia == inference. With the current generation, they are also recommending smaller Trainium configurations for inference.

Even if nobody trains another model, the Trainium chips will be useful for inference of existing models that have been recompiled for it.

[ Parent | on HN ]