New keypairs are often created, it's not the case that a person has a single keypair that they use for all transactions.

E.g. once you fund key A, immediately send the funds to new keys B, C, and D that are not publicly associated with you.