Yes that is true. I would add that typically most startups attack a particular niche first before taking on that strong competitor. A niche where that competitor is weak or absent.

Some of the best advice for you question is from Paul Graham: http://paulgraham.com/startupideas.html