"Live and let live" is a rule that works except when a minority is kept from pursuing opportunity. The job of the EEOC is to point out when businesses systematically prevent a particular group (sometimes white men!) from an equal opportunity to succeed.

"Live and let live" is not a universal maxim. It was the primary argument in opposition of federal government enforcement against segregation.