The 4A does actually evaporate for a subset of Americans. Reagan's EO12333 permits warrantless collection for Americans subject to background investigations. You are fair game for the panopticon from the submission of an SF86 application until the time you end your security clearance. The domestic surveillance apparatus exists, in part, to facilitate that need which is something the affected agencies want to preserve a carve out for.