This is very much a solved problem (see: coyote time), and is solved (for free!!!) by OS’s and web browsers. When you implement your own controls and do stupid stuff with JavaScript, you end up with exactly as you say.