Portugal was more concerned with getting trade goods from the far east than trying to build up sub-Saharan Africa for most of it's history. It just so happened that when the Scramble for Africa started, Portugal already had toeholds all along the coast.