There's also the issue that if the code wasn't bespoke but also sold to non-government entities for similar missions (i.e. government does not hold exclusive rights), then it can be protected as the contractors IP. But for the IRS this would be rare, they are pretty unique and often do things their own way.
* You can sort of do this without the code. The IRS is not allowed by legislation to base an audit decision on any information that is not covered by eFile, so contents of forms 1041QFT and 990T, or any attachments to what could have been an electronically submitted form, is out of scope. As long as what you submit in the core set of forms aren't statistical outliers, then you're good.
It really isn't - the point is freedom access, not free use. Information acquired this way doesn't magically become public domain, it may (or may not) have other constraints on it.
See e.g. https://www.justice.gov/oip/blog/foia-update-oip-guidance-co...