No that's how they build a profile, its pretty obvious that who you follow on Twitter/FB is seen as indicative of your interests (even if its not really, I follow ppl just to see what crazy sh*t they'll say next, but I'm also not applying for a visa or government clearance).

Your social media profile should be treated like a resume, especially if you tie it your real life identity, and you believe for any reason, that it'll be reviewed.