Isn't this an argument that doing anything that is illegal but beneficial to the conspirators should be left alone?

If it were totally allowed and widespread how would there be any pretence of fairness in the markets? Of course you could say that at least then people would be appreciating the reality of the situation . . .