Is your response "it's not feasible because when one fails, they all do"? Or is your response "it's not feasible because when one fails, they all could"?
There is an important distinction between those two.
Making the entire country dependent on GPS limits the options of the military organizations that established it in the first place, and compromises their mission to provide navigation to troops in the field. (in my opinion)
The vulnerability of satellites to deliberate attack should not place the entire nation in a position of vulnerability as well.
A ground based system in friendly territory, with a large number of separate sites, provides a redundancy in numbers that you just can't get from a few tens of satellites.
There should also be ongoing research into improving celestial and inertial navigation systems as yet another backup.
A long range system similar to the Omega system should also be deployed.
True redundancy requires inertial dead reckoning, celestial navigation, or land based navigation aids. Sadly, none of these are being widely deployed.