Involving the courts is by design. Because Congress decided to create this right, and because it's messy, and because creating rules around "messy" is a Hard Problem ... let's involve the courts! As evidence that this was intentional, see "fair use" - no one thinks they're allowed to make a fair use decision without filing a lawsuit.
Point: I get why the courts are involved. But I'm right there with you that the whole system gets used as an oppressive instrument.
Other industries could follow the fashion industry's lead and drop copyright infringment altogether. Somehow they manage survive and innovate without it using just social pressures, not legal pressures.