That's a gripe I share, but I run into it so infrequently that it's not much of a bother. Most likely when browsing network shares and such, which I tend to use something like Transmit or Forklift for instead.