Re:OpenAI and Nvidia Announce Partnership to Deploy 10GW of ...
by sindriava on Monday September 22, 2025 @02:49PM
(#45337791)
We know for a fact that current LLMs are massively inefficient, this is not a new thing. But every optimization you make will allow you to run more inference with this hardware, there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads.
Re:OpenAI and Nvidia Announce Partnership to Deploy 10GW of ...
by dragonwriter on Monday September 22, 2025 @03:22PM
(#45338236)
> But every optimization you make will allow you to run more inference with this hardware
Unless the optimization relies in part on a different hardware architecture, and is no more efficient than current techniques on existing hardware.
> there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads
Rail cars are pretty darned efficient, but they don’t really work on roads made for the other kind.
If each human brain consumes ~20W then 10 GW is like 500 M people, that sounds like a lot of thinking. Maybe LLMs are moving in the complete opposite direction and at some point something else will appear that vaporizes this inefficiency making all of this worthless.
I don’t know, just looking at insects like flies and all the information they manage to process with what I assume is a ridiculous amount of energy suggests to me there must be a more efficient way to ‘think’, lol.