But the "manufacturing and shipping a new one" part is temporary until the majority of cars are replaced. The reduced emissions from more efficient cars will be permanent.

Yes, retrofitting would be better, but if that's not possible, what else would you do to get converters into cars?

Also, I think GP was talking about removing a converter from a car that already had one. Literally not doing anything would be better for the environment than that.