Right. But you can buy a stock (without knowing it was a borrowed share in a short sale), and then lend it to someone else (who intends to sell, it, thus creating another short sale).

So to unwind this, the one existing share has to get bought (by someone who short-sold it), and returned (to the owner who lent it out), twice.