In my own county the costs of document scanning and record storage were in the 1 to 2 million dollar range for years. Oddly this coincided with the county commissioner having a husband that work for Xerox at the time, the Xerox office also handled the counties scanning and document storage. Amazingly after the time that commissioner was no longer in the office the contracts were renegotiated and the price dropped over 25%. The biggest issue I have seen working at the local government level for over a decade now is very few people without a stake in the game ever review the use of technology by the counties. Politics has far more sway than best practices.
In retrospect probably one of the dumber things I've ever done is not keep 2TB of county records from 1850 to 2008 after a company closed down operations. There wasn't any particular reason I couldn't keep them, they were paid for and the company didn't sell them off after closing. The server was likely neglected for years after that and eventually formatted.
I work in geospatial modelling and I use data like this every day; have been for 15 years. So I know a thing or two about availability of this sort of data, how hard it is to assemble and maintain, and how many people actually do something with it. In the EU, there are directives that create obligations for governments to offer all sorts of data freely to everybody. The amount of money this costs is staggering, and although I'm very happy with it (because it has made my life 100 times easier in the data respect), the useful stuff that is done with it by people who didn't have access to it before is minimal; and certainly disproportional to the amount of money that goes into it. The consultants are laughing all the way to the bank, of course (and hey, I get paid indirectly from it as well, so it's not like I'm complaining).
So that makes the 'data should be open' mantra an entirely ideological disposition. I used to believe it as well, but then why shouldn't we also say 'governments can only spend money on vegan stuff because some people believe in 'animals rights'?' I no longer see pet peeves like 'free data' as black and white as I used to. Bureaucracies are expensive, partly because their goal is not efficiency (which is something that is usually overlooked by the naive) and partly because of other effects inherent to them. We need to restrain ourselves in what and how much we demand from them.
- Keep taxes down and only support people who really have a serious need for it
- Cover the cost of packaging and distribution (and other associated costs)
I don't necessarily agree with this, but these are the kinds of justifications that are generally tossed around inside the government about these kinds of things.