Except that you do have a bunch of tagged photos with your friends in them, because they're your friends.

And the idea that someone who I haven't shared my photos with can still use them to tag me in other photos is not something that I would describe as a feature.