I do almost the same thing, but I turn it to scalding hot once I’m done using my fingers so the lenses get hot so they dry faster. So far that hasn’t seemed to damage anything.