Absolutely. If both parties can match people in their lists, they can find out who is who even if the lists contain some random ids instead of names.