I'd forgotten about Cygwin! Next time I think about it, that might be capable of removing said files as well (although, I guess that qualifies as a 3rd party tool).

I have it installed on my Windows machine. I ought to give it a try.