I did a rollout of USB smart cards. The use case had an average of 5 insertions per day, 225 days per year, 5 years. That number was well below what the mfg of the smart card and the laptop mfg said the USB connection would support.

For what it's worth the only time there was token damage was when people forgot to unplug and smacked the token into a door frame, bending the token connector.

YMMV.