News for hackers. Stuff that matters.
Re:Ilya Sutskever on Dwarkesh Patel's Podcast by energy123 on Tuesday November 25, 2025 @05:35PM (#46051662)
It still does help in the clean way it used to. The problem is that the physical world is providing more constraints like lack of power and chips and data. Three years ago there was scaling headroom created by the gaming industry, the existing power grid, untapped data artefacts on the internet, and other precursor activities.
Re:Ilya Sutskever on Dwarkesh Patel's Podcast by kmmlng on Tuesday November 25, 2025 @05:44PM (#46051762)
The scaling laws are also power laws, meaning that most of the big gains happen early in the curve, and improvements become more expensive the further you go along.