Even driving a few blocks, having to stop and fill up, and then getting back on the route can easily take 10 minutes of your time. Being able to plug in at home and never worrying about filling up unless you're on a long drive will save you a ton of time.

Not to mention the case where you're pressed for time and realize your car is on empty.

It's still an inconvenience. It's a minimum 5 minute detour, possibly more depending on your route, versus plugging in your car when you get home which adds maybe 10 seconds to your home routine.