At Syncplicity I built something like this in a hackathon. Right-click on a file and diff it with a different version.

Sadly, we never developed it.

But, yes, I totally agree with your rationale. This is the kind of rabbit hole that can quickly turn into a distraction.