News for hackers. Stuff that matters.

A comment on Cloud Run GPUs, now GA, makes running AI workloads easier for everyone. Parent comment

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by mgraczyk on Wednesday June 04, 2025 @04:57PM (#44185468)
Depending on your model, you may spend a lot of time trying to get it to work with Trainium
[ Parent | on HN ]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by krembo on Tuesday June 17, 2025 @01:11PM (#44301365)
Why is that? Can you explain?
[ Parent | on HN ]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by mgraczyk on Tuesday June 17, 2025 @01:16PM (#44301414)
The trainium toolchain is not as mature as GPU. Your model may fail to compile out of the box, and even if it does it may be slow and require you to dig into details for reasonable training/inference performance
[ Parent | on HN ]