Regardless of whether you're making above the median and your skills have more value, that should not require you to suffer a pay cut to spend 1-2 years doing thankless work.

Regardless of DC median wages, housing is very expensive to be reasonably close to where you'd be working onsite for 18F or USDS assignments.