It happens to me maybe once every 5-10 years, whereas I open and close various credit card accounts several times a year. So for me it would be far more irritating to have to add and remove cards from my phone's virtual wallet several times a year than to potentially have to order a replacement card once every few years. Most phone wallets also don't give an option to provide a nickname for cards, which is extremely irritating if you have multiple cards from the same issuers, whereas with physical cards it takes a couple of seconds to add/remove cards from my wallet, or to make a note on a card with a sharpie.