Battery life is not the only concern; a device that sits in your hand or your pocket needs to carefully manage heat.
We had one device I was helping bring up where you could run the GPU full-tilt for ~60s. After that the device would reboot and fail to come up until it had cooled enough. Was a fun process characterizing that device and our workloads in 60s bursts. Couple weeks later they had it tuned in where you could run it 24/7 as the thermal limits kicked in pretty aggressively.
Power management and thermal budgets are a very real thing. The times where all device’s components would run at full speed are (thankfully) over for quite some time.
20 years ago PCs had multiple incredibly loud constantly running fans, that I think hardly anyone would put up with anymore (and would obviously not work for phones anyway). Today’s phones are extremely more powerful than those PCs in many ways, and yet consume a fraction of energy per time unit. Does not work without complex power management.
The industry didn't focus much on quietness, that's true.
(I used to assemble and sell custom-built PCs around 1996 to 2000.)
Even with computers that could be run all passively at that time, there is just no comparison to today's smartphones, which sit in our pockets and are orders of magnitude more capable along almost every axis.