> The degree doesn't matter in most of tech but if I ever wanted to work for the government or military I'd be automatically disqualified for not having a degree despite having the ability.

You do not need a degree to work for the government or military, at least not as a contractor, and almost all of the interesting work is done by contractors.