If it were just about keeping exact measurements of time, there would be no need to regularly resynchronize the standard timekeeping system with the rotation of the Earth. The only thing that makes it important to tie clock noon to solar noon (which is the entire purpose of leap seconds) is to maintain human beings' perception of what "noon" is supposed to mean (over the very long term).