The Samsung Galaxy S5 from 2014 had a removable battery, headphone jack, a microSD card slot, and was IP67 dust/water resistant. We lost removable batteries because it was an easy way to make devices obsolete.
IMO smartphones peaked around that era, and we've only seen incremental improvements and enshittification ever since. I used to be excited about every new device, but these days all manufacturers are grasping at straws trying to differentiate their rectangular slabs from the competition. AI is the latest gimmick in this trend.
It would be nice to be able to pop batteries in and out on the fly, but I suspect that would make it a lot harder to waterproof. I've lost more phones to water damage than I have to battery death.