Sometimes my Tesla charges “too fast” (~20 min) and I have to move the vehicle before my shopping or rest stop is complete. It helps to colocate fast chargers at businesses people patron anyway (supermarkets, for example), where they’ll naturally take longer than the vehicle will take to charge. These are solved problems, it’s install and equipment colocating logistics at this point.
If there is parking lot charging where you shop you can overlap it with shopping, although most efforts I've seen in that direction only have a handful of charging spots. Maybe someday there will be enough of those spots that people who don't have home or work charging will be able to do much of the charging while shopping.
But as long as we are still at the stage where many people would have to specifically go to a charging place much like they currently refuel their ICE, the speed difference will be noticeable.
For a person that drives the average amount in the US it is about an hour a year sitting at gas stations vs about 11 hours a year sitting at fast charging stations.
(Of course there may be offsetting time savings. I believe some places allow EVs to use HOV lanes regardless of the number of passengers. If you have a solo commute during times of high traffic, the HOV lanes might save you more than 10 hours a year).