That still leaves a huge pool of speakers. Probably not enough to make it the 'most spoken language in the world by 2050'[0] because it is mostly spoken by educated and urban people, and far less in the countryside, but enough to make it a dynamic, growing language.
[0] : http://www.forbes.com/sites/pascalemmanuelgobry/2014/03/21/w...
[1]http://en.wikipedia.org/wiki/List_of_countries_where_French_...
Rwanda in particular is not in practice really part of French-speaking Africa anymore. The numbers you link show only 3% of Rwandans speak partial French, which is barely more than any other country where a handful of people choose French as a foreign language in school. That's related to the ethnic unrest in the country; much of the current elite are ex-refugees who grew up in Uganda, which is not Francophone, and there's also a political edge to it because they consider France to have been too close to the previous Hutu-dominated government.