The IRS has invested a lot in low effort automated audits that catch non-rich people when they try to cheat on their taxes (they are usually not very smart about it), while the rich people who can afford accountants and lawyers make their cases too expensive in manual effort and time to pursue under a cut budget. They just can only audit so many millionaires+ every year, while they can audit almost everyone else with a push of a button.