You're right, my perception was influenced by how many of my cards are debit cards or debit-like (i.e. prepay of some kind). When those switched issuer over the years, it was always Mastercard -> Visa.