One hypothesis for why you see both anecdotes is that the IRS is extremely good at filtering out these cases… when they bother to look into it. A lot probably get by without ever being audited, but the small percentage that do regret it.