News for hackers. Stuff that matters.
Re:A bottle of water per email: the hidden environmental cos... by MSFT_Edging on Wednesday September 18, 2024 @08:10AM (#41578725)
Datacenters aren't running M-series chips.
Re:A bottle of water per email: the hidden environmental cos... by guitarlimeo on Wednesday September 18, 2024 @08:12AM (#41578741)
Well not M-series chips specifically, but chips optimized for these kind of workloads (like the neural engine in M-series chips is).
Re:A bottle of water per email: the hidden environmental cos... by dartos on Wednesday September 18, 2024 @08:35AM (#41578946)
IIRC The M series chip isn’t specifically optimized for ML workloads, the biggest gain it has is having unified video and cpu memory as transferring layers between the two is a big bottleneck on non Apple systems.

Real ML hardware (like the Nvidia H1000s) that can handle the kind of inference traffic you see in production get hot and use quite a bit of energy, especially when they run at full blast 24/7

Re:A bottle of water per email: the hidden environmental cos... by gcr on Wednesday September 18, 2024 @08:33AM (#41578933)
Google’s TPU energy usage is a well-kept secret / competitive advantage. If energy efficiency isn’t a major concern for them, I bet it will be in a couple years.