Me as well, until I bought Forza Horizon and discovered my car had a turbo..

I don't dispute that some loud exhausts are the result of exactly what you describe, but also many are motorheads who have less restrictive exhaust systems for performance reasons or just to enjoy their vehicle (unfortunately sometimes at the expense of other peoples hearing)