You can get battery powered compasses that you stick on your dash. :)

My car's review mirror has a compass in it and I use it for navigation quite often.

Places I had to drive to before GPS are places I have a better understanding of how to get to. I have a friend who refuses to use GPS and his knowledge of the city is far far ahead of mine.

Of course I am lucky to live in a place built on a true x-y coordinate grid system where given any address you can navigate to it w/o issue using, well, just a compass. :)

I wouldn't try that trick in London! :) (There is a cool documentary about London cab drivers and what they have/had to go through to memorize the entire city)