It will never close (unless you click "shut down anyway"). Maybe I'll dig into that some day - after a quick google, maybe it just doesn't honor the window messages to close the program.

I use a portable install anyway, so that hopefully won't be an issue (if I ever get around to testing)!