A relevant analogy is small fish in a big pond or big fish in a small pond. You are effectively making the pond smaller by going into a more specific niche.