That's not at all true by default; you also see tweets from people that have paid for involuntary reach for the tweet (promoted tweets), tweets that people you follow have interacted with, tweets that respond to or mention people you follow, and probably others that I'm forgetting.