A "small" 7 rack, SOTA CPU cluster uses ~700KW of energy for computing, plus there's the energy requirements of cooling. GPUs use much more in the same rack space.
In DLC settings you supply 20-ish degree C water from primary circuit to heat exchanger, and get it back at 40-ish degree C, and then you pump this heat to environment, plus the thermodynamic losses.
This is a "micro" system when compared to big boys.
How there can be no environmental harm when you need to run a power plant on-premises and pump that much heat in much bigger scale 24/7 to environment.
Who are we kidding here?
When this is done for science and intermittently, both the grid and the environment can tolerate this. When you run "normal" compute systems (e.g. serving GMail or standard cloud loads), both the grid and environment can tolerate this.
But running at full power and pumping this much energy in and heat out to train AI and run inference is a completely different load profile, and it is not harmless.
> the cognitive harms and AI supported suicides
Extensive use of AI is shown to change brain's neural connections and makes some areas of brain lazy. There are a couple of papers.
There was a 16 year old boy's ChatGPT fueled death on the front page today, BTW.
> This is the best argument on the page imo, and even that is highly debated.
My blog is strictly licensed with a non-commercial and no-derivatives license. AI companies gets my text, derives it and sells it. No consent, no questions asked.
Same models consume GPL and Source Available code the same and offer their derivations to anyone who pays. Again, infringing both licenses in the process.
Consent & Copyright is a big problem in AI, where the companies wants us to believe otherwise.
> There is constant active rhetoric around the sycophancy, and ways to reduce this, right? OpenAI just made a new benchmark specifically for this.
We have investigated ourselves and found no wrongdoing
> Im uneducated here, honestly. I don't ask a lot of race-based questions to my LLMS I guess
Do you have to ask a race-based question to an LLM for it to give you biased or racist output?
I don't think they, have, no. Perhaps I'm overlooking something, but their most recent technical paper [0], published less than a week ago, states, "This study specifically considers the inference and serving energy consumption of an AI prompt. We leave the measurement of AI model training to future work."
Also, note that it is the _median_ usage for Gemini. One would assume that the median Gemini usage is that pointlessly terrible Google Search results widgets, the one that tells people to eat rocks. Which you've got to assume is on the small side, model-wise.
You can't even ask it anything for genuine curiosity it starts to scold you and makes assumptions that you are trying to be racist. The conclusions I'm hearing are weird. It reminds me of that one Google engineer who quit or got fired after saying AI is racist or whatever back in like 2018 (edit: 2020).
All these points are just trying to forcefully legitimise his hatred.
Also, I think their lean towards a political viewpoint is worth some attention. The point is a bit lost in the emotional ranting, which is a shame.
(To be fair, I liked the ranting. I appreciated their enjiyment of the position they have reached. I use LLMs but I worry about the energy usage and I’m still not convinced by the productivity argument. Their writing echoed my anxiety and then ran with it into glee, which I found endearing.)
I'd be interested to see that report as I'm not able to find it by Googling, ironically. Even so, this goes against pretty much all the rest of the reporting on the subject, AND Google has financial incentive to push AI, so skepticism is warranted.
> I don't ask a lot of race-based questions to my LLMS I guess
The reality is that more and more decision making is getting turned over to AIs. Racism doesn't have to just be n-words and maga hats. For example, this article talks about how overpoliced neighborhoods trigger positive feedback loops in predictive AIs https://www.ohchr.org/en/stories/2024/07/racism-and-ai-bias-...
> Copyright never stopped me from saving images or pirating movies.
I think we could all agree that right-clicking a copyrighted image and saving it is pretty harmless. Less harmless is trying to pass that image off as something you created and profiting from it. If I use AI to write a blog post, and that post contains plagiarism, and I profit off that plagiarism, it's not harmless at all.
> I also grew up being told that ANYTHING on the internet was for the public
Who told you that? How sure are you they are right?
Copilot has been shown to include private repos in its training data. ChatGPT will happily provide you with information that came from textbooks. I personally had SunoAI spit out a song that whose lyrics were just Livin' On A Prayer with a couple of words changed.
We can talk about the ethical implications of the existence of copyright and whether or not it _should_ exist, but the fact is that it does exist. Taking someone else's work and passing it off as your own without giving credit or permission is not permitted.
I think the main problem for me is that these companies benefit from copyright - by beating anyone they can reach with the DMCA stick - and are now also showing they don't actually care about it at all and when they do it, it's ok.
Go ahead, AI companies. End copyright law. Do it. Start lobbying now.
(They won't, they'll just continue to eat their cake and have it too).
So far, case law is shaping up towards "nope, AI training is fair use". As it well should.
Copyright law is a disgrace, and copyright should be cut down massively - not made into an even more far-reaching anti-freedom abomination than it already is.
This is absolutely not true.
> Together, the nation’s 5,426 data centers consume billions of gallons of water annually. One report estimated that U.S. data centers consume 449 million gallons of water per day and 163.7 billion gallons annually (as of 2021)
> Approximately 80% of the water (typically freshwater) withdrawn by data centers evaporates, with the remaining water discharged to municipal wastewater facilities.
It's pretty clear there are impacts, AI needs energy, consumes material, creates trash.
You probably just don't mind it. The fact is still fact, the conclusion is different, you assess it's not a big concern in the grand scheme of it and worth it for the pros. The author doesn't care much for the pros, so then any environmental impact is a net loss for them.
I feel both take are rational.
You can:
1. Dismiss it by believing the projections are very wrong and much too high
2. Think 20% of all energy consumed isn't that bad.
3. Find it concerning environmentally
All takes have some weight behind them in my opinion. I don't think this is a case of "arsenic-free cauliflower", maybe unless you claim #1, but that claim can't really invalidate the others on their rational, they make an assumption on the available data and reason of it, the data doesn't show ridiculously small numbers like it does in the cauliflower case.
> data centers account for 1% to 2% of overall global energy demand
So does the mining industry. Part of that data center consumption is the discussion we are having right now.
I find that in general energy doesn't tend to get spent unless there's something to be gained from it. Note that providing something that uses energy but doesn't provide value isn't a counterexample for this, since the greater goal of civilization seems to be discovering valuable parts of the state space, which necessitates visiting suboptimal states absent a clairvoyant heuristic.
I reject the statement that energy use is bad in principle and pending a more detailed ROI analysis of this, I think this branch of the topic has ran its course, at least for me :)
Ok, but that's the figure that would be alarming, AI is projected to consume 20% of the global energy production by 2030... That's not like the mining industry...
> I find that in general energy doesn't tend to get spent unless there's something to be gained from it
Yes, you'd fall in the #2 conclusion bucket. This is a value judgement, not a factual or logical contradiction. You accept the trade off and find it worth it. That's totally fair, but in no way does it remove or mitigate the environmental impact argument, it just judges it an acceptable cost.
It is legitimately one of the most misleading pieces of press I've read in a while.
The 21% value is unsourced, the single image = full phone charge is wrong in so many ways I had written 3 paragraphs picking apart both the MIT publication and the huggingface paper's methodology, and so on.
I'm happy to be given evidence that AI is ruinous in terms of more than its social effects, but this publication has made me incredibly suspicious of anyone claiming this to be the case.
But as it stands the author indirectly loves Netflix.
You don't see the difference, or are you willfully ignorant?
Yes, it means that "suddenly" we need to do more of everything than we did for entirety of human history until ~few years ago. Same was true ~few years ago. And ~few years before that. And so on.
That's what exponential growth means. Correct for that, and suddenly we're not really doing things that much faster "because AI" than we'd be doing them otherwise.
No hate, but consider — when I feel that way, it’s often because one of my ideas or preconceptions has been put into question. I feel like it’s possible that I might be wrong, and I fucking hate that. But if I can get over hating it and figuring out why, I may learn something.
Here’s an example:
> Didn't google just prove there is little to no environmental harm, INCLUDING if you account for training?
Consider that Google is one of the creators of the supposed harm, and thus trusting them may not be a good idea. Tobacco companies still say smoking ain’t that bad
The harm argument is simple — AI data centers use energy, and nearly all forms of energy generation have negative side effects. Period. Any hand waving about where the energy comes from or how the harms are mitigated is, again, bullshit — energy can come from anywhere, people can mitigate harms however they like, and none of this requires LLM data centers.
Presented like this, the argument is complete bullshit. Anything we do consumes energy, therefore requires energy to be supplied, production of which has negative side effects, period.
Let's just call it a day on civilization and all (starve to death so that the few survivors can) go back to living in caves or up the trees.
The real questions are, a) how much more energy use are LLMs causing, and b) what value this provides. Just taking this directly, without going into the weeds of meta-level topics like the benefits of investment in compute and energy infrastructure, and how this is critical to solving climate problems - just taking this directly, already this becomes a nothing-burger, because LLMs are by far some of the least questionable ways to use energy humanity has.
How much power does a typical gaming rig draw these days?
Viewing energy use as an axiomatic evil necessarily leads to the removal of man from the earth.
You're not uneducated, but this is a common and fundamental misunderstanding of how racial inequity can afflict computational systems, and the source of the problem is not (usually) something as explicit as "the creators are Nazis".
For example, early face-detection/recognition cameras and software in Western countries often had a hard time detecting the eyes on East Asian faces [0], denying East Asians and other people with "non-normal" eyes streamlined experiences for whatever automated approval system they were beholden to. It's self-evident that accurately detecting a higher variety of eye shapes would require more training complexity and cost. If you were a Western operator, would it be racist for you to accept the tradeoff for cheaper face detection capability if it meant inconveniencing a minority of your overall userbase?
Well, thanks to global market realities, we didn't have to debate that for very long, as any hardware/software maker putting out products inherently hostile to 25% of the world's population (who make up the racial majority in the fastest growing economies) weren't going to last long in the 21st century. But you can easily imagine an alternate timeline in which Western media isn't dominant, and China & Japan dominate the face-detection camera/tech industry. Would it be racist if their products had high rates of false negatives for anyone who had too fair of skin or hair color? Of course it would be.
Being auto-rejected as "not normal" isn't as "racist" as being lynched, obviously. But as such AI-powered systems and algorithms have increasing control in the bureaucracies and workflows of our day to day lives, I don't think you can say that "racist output", in the form of certain races enjoying superior treatment versus others, is a trivial concern.
[0] https://www.cnn.com/2016/12/07/asia/new-zealand-passport-rob...
That's a crazy argument to accept from one of the lead producers of the technology. It's up there with arguing that ExxonMobil just proved oil drilling has no impact on global warming. I'm sure they're making the argument, but they would be doing that wouldn't they?
Of course, they hide the truth in plain site: inference is a drop in the ocean compared to training.
No, they showed that the environmental impact of using a smaller AI embedded on Google results uses less power to train and run than using something SOA. That's quite a different thing altogether.
> I don't ask a lot of race-based questions to my LLMS I guess
You don't need to ask explicit questions to receive answers where bias is implicitly stated. You've dismissed the argument out of hand without actually meeting it.
> I won't deny it's an issue but to act like it's being ignored by the industry is a miss completely.
The claim was that critics had been vocal about it, not that it had been ignored by the industry.
> I also grew up being told that ANYTHING on the internet was for the public, and copyright never stopped me from saving images or pirating movies.
Policing is always very patchy. You maybe broke the law and got away with it as an individual, that's common. The issue is that these huge businesses can do a level of copyright infringement, and do it on a for-profit basis, while smaller businesses would be eradicated for attempting the same thing, and the artists they're taking from would face similar issues if they attempted even a fraction of that level of plagiarism.
This paragraph really pisses me off and I'm not sure why.
> Critics have already written thoroughly about the environmental harms
Didn't google just prove there is little to no environmental harm, INCLUDING if you account for training?
> the reinforcement of bias and generation of racist output
Im uneducated here, honestly. I don't ask a lot of race-based questions to my LLMS I guess
>the cognitive harms and AI supported suicides
There is constant active rhetoric around the sycophancy, and ways to reduce this, right? OpenAI just made a new benchmark specifically for this. I won't deny it's an issue but to act like it's being ignored by the industry is a miss completely.
>the problems with consent and copyright
This is the best argument on the page imo, and even that is highly debated. I agree with "AI is performing copyright infringement" and see constant "AI ignores my robots.txt". I also grew up being told that ANYTHING on the internet was for the public, and copyright never stopped *me* from saving images or pirating movies.
Then the rest touches on ways people will feel about or use AI, which is obviously just as much conjecture as anything else on the topic. I can't speak for everyone else, and neither can anyone else.