My personal belief is that there must be a very low bar for driving because In many places in the US, if you don't have ready access to a car for transportation, your life will be very difficult. Poor public transportation combined with massive sprawl ensure this.

Also, generally speaking, Americans do not like things that add perceived barriers to their personal freedom and independence, so any proposal to make it more difficult to get a license would probably be unpopular.