This is what I do, usually once or twice a day. I seem to touch my face and glasses a lot, so dish soap is important as it removes the grease. Hand soap isn't as powerful and often has additives that will leave a film behind.

Between cleanings when I get a small smudge I go back to using my t-shirt, but I only clean the specific area that is dirty.