The IRS doesn't refuse to interact with anyone. They want their money no matter how you made the income, and if you're in the country legally or not.

Remember, what they ultimately got Al Capone on wasn't racketeering, bootlegging or murder, it was tax evasion.