It mostly depends on stable borders and a culture of centralization. Some US states such California and Texas have multiple major cities. Germany and the surrounding areas were historically fragmented, leading to many regions having multiple mid-tier cities instead of a single dominant city.