It's just one of those things that people say it's not a good idea then get used to it. However, it does provide a great way for spammers to get into your activity stream. It also gets in the way of twitter's casual model of following and un-following when you raise the visibility a notch.