I already use this feature but I can reliably find my driveway on the heatmap so either a) they aggregate everything into the heatmap regardless of the privacy sphere or b) it's from my friends visiting, picking me up, etc.

Either way, there's a very clear route that leaves the road at my house and follows my driveway. It doesn't take much effort to find many, many more examples of this throughout the heatmap.