Even "no filing" won't get you in prison if you were not aware that you weren't filing. Happened to me once for state taxes, specifically. A lot of us were remote and didn't realize the company we were working for had messed up and not reported anyone's income to the state.

That said, yes, if you are attempting active fraud, then you are doing more than just making mistakes on your taxes.