They were very very rich before colonization?

Africa's poverty is an African issue. In fact (and don't take this as a pro-colonization statement because I'm very anti-colonization) they were in many cases materially better off under foreign rule. Zimbabwe comes to mind.