Binney and Wiebe left NSA at what I think was the low point of the agency, after losing political battles internally and getting marginalized.

TAO, the shift to attacking IP networks, the shift to active attacks on commercial technologies (vs. spending years to defeat a decade-long-lifecycle foreign comm or cryptosystem), etc. mostly happened after they'd left.