Isn't that what using zippey as a filter is doing?
My understanding is that you git repo would include a compression optimised binary.. rather than a list of text files.
A script to sort of ‘package to git’ and one to ‘unpackaged from hit’ would allow the text files to be more easily managed within git.
This could be supported with a short bash script that did unzip and git commit (I’d call it unzit as the name makes me laugh).
And then do builds as the last step, either storing the original zip file or having a way to zip things back up.