News for hackers. Stuff that matters.
Re:Mistral's new "environmental audit" shows how much AI is ... by tomhow on Monday July 28, 2025 @02:18AM (#44707747)
Mistral reports on the environmental impact of LLMs - https://news.ycombinator.com/item?id=44651661 - July 2025 (56 comments)
Re:Mistral's new "environmental audit" shows how much AI is ... by linotype on Monday July 28, 2025 @02:04AM (#44707667)
I’ll stop using ChatGPT when private jets are banned, families drop down to one car and stop having more than two kids. Seriously there are probably more emissions from a few supertankers/cargo carriers than all LLMs combined.
Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @02:14AM (#44707726)
No one is asking people to stop using the Internet. However, becoming aware of one’s consumption is important, and as of now, people are generally oblivious to their digital footprint beyond power consumption, which is only one of the aspects.
Re:Mistral's new "environmental audit" shows how much AI is ... by nsksl on Monday July 28, 2025 @09:58AM (#44710940)
Of course they are. We continuously hear that we have to stop having cars, kids, and consuming in a way that the elites have described as irresponsible, all whilst they travel the world in private jets where they definitely do not eat tofu.
Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @05:53PM (#44716150)
I guess you should just walk outside a bit.
Re:Mistral's new "environmental audit" shows how much AI is ... by Zacharias030 on Monday July 28, 2025 @02:09AM (#44707696)
3 if you raise them vegan!
Re:Mistral's new "environmental audit" shows how much AI is ... by readthenotes1 on Monday July 28, 2025 @03:32AM (#44708198)
it made me look. a private jet emits 4,900 g of c02 per mile (how the author's mind didn't explode mixing the measurement systems is beyond me) vs 1 prompt emitting 1.14 g.

https://flybitlux.com/what-is-the-carbon-footprint-of-a-priv...

Re:Mistral's new "environmental audit" shows how much AI is ... by BriggyDwiggs42 on Monday July 28, 2025 @04:48AM (#44708729)
Honestly not as dramatic as I’d have hoped. 5000 chatgpt prompts propelling a jet for a mile is a pretty surprising amount of energy useage.
Re:Mistral's new "environmental audit" shows how much AI is ... by lostmsu on Monday July 28, 2025 @10:08AM (#44711046)
Yeah, but it's multiple million per flight
Re:Mistral's new "environmental audit" shows how much AI is ... by BriggyDwiggs42 on Monday July 28, 2025 @01:17PM (#44712985)
Yeah but chatgpt has like a hundred million users right?
Re:Mistral's new "environmental audit" shows how much AI is ... by lostmsu on Monday July 28, 2025 @02:29PM (#44713777)
I fail to see a point in this comment. We are comparing 100 million users to a single jet flight. If you believe that a flight is more important that a few million conversations for anyone, sure I can see how you can be concerned.
Re:Mistral's new "environmental audit" shows how much AI is ... by linotype on Monday July 28, 2025 @08:11PM (#44717432)
Most private jet flights are more than one mile in length and there are many thousands of them per day. There’s no where you can go (effectively) that you can’t get to with a major airline.

https://www.pbs.org/newshour/science/carbon-pollution-from-h...

Re:Mistral's new "environmental audit" shows how much AI is ... by Buxato on Monday July 28, 2025 @06:16AM (#44709230)
WTF, the level of .... in this phrase is astonishing IMO, specially when you said the kids "issue". Seriously WTF
Re:Mistral's new "environmental audit" shows how much AI is ... by linotype on Monday July 28, 2025 @10:27AM (#44711204)
> WTF, the level of .... in this phrase is astonishing IMO, specially when you said the kids "issue". Seriously WTF

What?

Re:Mistral's new "environmental audit" shows how much AI is ... by votepaunchy on Monday July 28, 2025 @09:27AM (#44710677)
Let’s talk about fewer kids after people stop owning pets.
Re:Mistral's new "environmental audit" shows how much AI is ... by danieldk on Monday July 28, 2025 @12:01PM (#44712157)
We have one electric car (that only my wife can drive because I don’t have a license). One kid. Switched to electric cooking and a heat pump all on windmill/solar energy. I never had a private jet, but last time our family flied was sever years ago.

So, when do you stop using ChatGPT? :) (seems like a small sacrifice in comparison)

On a serious note, whataboutism is not going to save us from climate disaster. There is always an excuse to not do the right thing.

Re:Mistral's new "environmental audit" shows how much AI is ... by M4v3R on Monday July 28, 2025 @02:05AM (#44707679)
> environmental impact of a single average prompt (generating 400 tokens' worth of text, or about a page's worth) was relatively minimal: just 1.14 grams of CO2 emitted and 45 milliliters of water consumed

While it’s non-zero, it doesn’t strike me to be “hurting the planet” as some people would want me to believe I’m doing when I decide to use LLMs.

Yes, the training has a much bigger impact but the benefits of training are shared will all users and it’s a one-time cost per model.

I did the math and if I’m right the environmental footprint of a single LLM training, emitting 13,600 metric tons of CO2 and consuming 187,333 cubic meters of water annually, represents 0.000026% of global greenhouse gas emissions and 0.0000047% of freshwater use.

Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @02:17AM (#44707740)
How many trainings and retraining are happening as we speak? How many more when the transition from millions of jobs replaced by AI do you expect? What about inference across all of that?
Re:Mistral's new "environmental audit" shows how much AI is ... by M4v3R on Monday July 28, 2025 @02:32AM (#44707824)
> How many trainings and retraining are happening as we speak?

Quite a lot. Let's assume a hundred different LLMs of this scale are being trained at the same time. If you multiply the global use percentages by a hundred you'll get: 0.0026% of global greenhouse gas emissions and 0.00047% of freshwater use. Still a literal drop in the bucket.

> How many more when the transition from millions of jobs replaced by AI do you expect?

Dunno, but the argument is that I should feel bad about my current impact on the environment as I use my LLM to autocomplete my code or answer my questions. We have no idea what the future will hold. We can and of course should do everything to minimize the environmental impact of everything we do, but that's a different discussion. For example switching to clean energy sources will make a big positive impact on these numbers.

> What about inference across all of that?

The report speaks about that, the inference cost in marginal when compared to the training cost (~15% for CO2 and ~9% for water consumption).

Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @02:53AM (#44707972)
> Quite a lot. Let's assume a hundred different LLMs of this scale are being trained at the same time.

It won’t be 100, you are underestimating it to make the number be small, ignoring the fact that people are talking about GW worth of continuous power, not counting the refresh rate of GPUs (every 3-5 years the whole infrastructure is renewed).

> Dunno, but the argument is that I should feel bad about my current impact on the environment as I use my LLM to autocomplete my code or answer my questions.

That’s not the argument. The argument is that you should be aware of your consumption and therefore the impact it has. Right now people use everything as a ‘’dumb’’ magical API that just spits things out from nowhere with no impacts.

> The report speaks about that, the inference cost in marginal when compared…

Don’t ignore how many of these are happening as we speak. ChatGPT went from 0 to 100mi users within months, all submitting hundreds of queries.

Re:Mistral's new "environmental audit" shows how much AI is ... by M4v3R on Monday July 28, 2025 @04:33AM (#44708621)
> It won’t be 100, you are underestimating it to make the number be small

Make it a 1000 (I seriously doubt there are one thousand simultaneous training runs of Mistral Large 2 scale models going on every second) and it's still a drop in the bucket.

> not counting the refresh rate of GPUs (every 3-5 years the whole infrastructure is renewed

I am accounting for this by citing annual usage instead of one-time cost.

Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @06:26AM (#44709304)
Not sure what you think demand is, but operators are building 10 GW AI datacenters. Assuming a GPU consumes ~1 kW, the number is potentially (upper bound) 10 GW / 1 kW, way larger than ‘1000’. For one company.
Re:Mistral's new "environmental audit" shows how much AI is ... by lostmsu on Monday July 28, 2025 @10:04AM (#44710997)
Still drop in the bucket considering world total electricity production is about 10 TW.

Where did you read one company? I found 10 GW new capacity next year for the entire industry.

Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Monday July 28, 2025 @05:51PM (#44716135)
It is not a drop in the bucket when we are talking about a factor of 1000000 (and not 100 as your initially calculated), on par with buildings and transportation, only behind agriculture.
Re:Mistral's new "environmental audit" shows how much AI is ... by lostmsu on Tuesday July 29, 2025 @01:07AM (#44719271)
Me? Also, 100 was the number of trained LLMs. Do you think there will be 1 000 000 trained at the same time at some point?
Re:Mistral's new "environmental audit" shows how much AI is ... by zekrioca on Wednesday July 30, 2025 @05:23AM (#44732312)
Sorry, @OP, not you :)

Yes, there will be. But the point is that potentially, all of these GPUs will be at 100% at all times, which makes the 1 000 000 realistic.

Re:Mistral's new "environmental audit" shows how much AI is ... by M95D on Monday July 28, 2025 @03:19AM (#44708133)
The surprizing conclusion for me from this article is not how much LLM hurts the planet, but how much video streaming hurts the planet!
Re:Mistral's new "environmental audit" shows how much AI is ... by riffraff on Monday July 28, 2025 @02:19AM (#44707752)
Is this article showing an ai slop header image with credits to Getty Images? I'm deeply confused.
Re:Mistral's new "environmental audit" shows how much AI is ... by joegibbs on Monday July 28, 2025 @02:38AM (#44707868)
It’s definitely a render, look how clear the small text is, you can see the lower resolution ground texture in the foreground.