You can have the activity graph show private contributions.

edit: I may have misunderstood, assuming you mean it's patchy because you're contributing to a private repo that's not on Github.