This is the real issue, I think. Facebook taking your data has no concrete consequences for most people, so it's easy to see why they might think of the typical "don't use Facebook, it's bad" as fearmongering.