My (opinionated) take is that if you learn 4 basic plots, it will take you far. These are easy to do with Pandas. In fact, I think the easiest way to do Matplotlib is with pandas rather than the Matplotlib API.

I do pull out plotly for 3d scatter plots (for PCA visualization). Matplotlib is horrible for this.