I do not speak for GitHub, but anonymous sources inform me that the feature only works with prose formats that have a built-in renderer. So basically, if you can preview the file, you can get a rendered diff for it.

This seems to confirm your suggestion :-)