Yeah when you put it like that it sounds bad, but Facebook really are right that literally every other advertiser on the planet does exactly the same thing.

Honestly I think the bigger issue is that Facebook tracks you on third party sites when you are logged in to Facebook - in those cases they easily know your exact identity. Most advertisers can't do that. Google could, but I'm not sure if they do or not.