I think it's just dry skin. When I worked in corporate IT we had the same issue with Yubikey 'not working' and almost all of those issues came from people working in an especially arid part of the country. "Lick your finger" fixed it every time.