The few applications that need accurate astronomical/solar time that can't just use a fixed function correction are already not happy with a half second of error and use more accurate alternatives.
It will take about 4000 years for the lack of leapseconds to move solar noon by an hour. At that point, if anyone cares at all, timezone offsets can be adjusted for another 4000 years of no trouble. Timezones are a regular thing that everyone is already forced to handle.
Leap seconds have caused untold amount of damage due to issues correctly handling them and spurious triggering. They severely inhibit the potential for stable secure autonomous time-- which is becoming increasingly realistic with the lowering cost of highly stable clocks.
Leap seconds sound like a barely good idea even when you ignore their costs but with their costs in mind they are insanity.