News for hackers. Stuff that matters.
Re:OpenAI and Nvidia Announce Partnership to Deploy 10GW of ... by sindriava on Monday September 22, 2025 @02:49PM (#45337791)
We know for a fact that current LLMs are massively inefficient, this is not a new thing. But every optimization you make will allow you to run more inference with this hardware, there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads.
Re:OpenAI and Nvidia Announce Partnership to Deploy 10GW of ... by dragonwriter on Monday September 22, 2025 @03:22PM (#45338236)
> But every optimization you make will allow you to run more inference with this hardware

Unless the optimization relies in part on a different hardware architecture, and is no more efficient than current techniques on existing hardware.

> there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads

Rail cars are pretty darned efficient, but they don’t really work on roads made for the other kind.