You make a great point. Can anyone explain why software is exempt from this?

They are not exercising a copyright claim when they don't release things, they're just not releasing them. Public domain only helps you if you have access to the work.

In addition to the point already made that the government has no obligation to release anything, code written by contractors is generally copyright by the contractors.