If you had any sort of local assets beyond a simple checking account, such as a retirement account or real estate, you were probably doing it wrong and are lucky not to have gotten caught.

Edited to add: either that, or you were doing it before 2010 or so, in which case, yeah, it was apparently way simpler back then.