I know the companies are optimizing for other metrics where the inconvenience might be measurable but I think that's a failure of regulation then. The platform could be made liable like we do with copyright material, for example, and then like YouTube they would be incentived to accept a higher false positive rate and automatically filter repeat offenders out.
But the issue with YouTube etc. isn't flagging innocent people, it's flagging innocent people and then rejecting their appeals. It should be pretty easy for PornHub etc. to get videos "verified" by getting explicit consent from all parties filmed, so that they cannot be flagged and removed from the system.
In fact, I really don't see any reason against a law requiring all porn sites to require verification for all videos (w/ retroactive revoke on the hosts). Nobody's being censored, and if you agree to be in a porn video you kind of waive your right to anonymity.
Then the host gets hacked and your government ID gets published as a creator of amateur pornography. The risk of that is de facto censorship by chilling effect.
Although I think that says "produces" rather than "publishes" or "distributes", so pornhub themselves aren't liable but the boyfriend "producing" the film has committed an offence. Not that there's any will to enforce this.
Closer to home, Scotland explicitly banned revenge porn, and has actually achieved some prosecutions.
There is a natural law in pattern recognition governing the split between sensitivity and specificity in scenarios with uncertainty, though I don't know if it has a special name. Catching more edge cases in a poorly-defined group requires allowing the inclusion of more things that look a lot like edge cases, but cases on the edge of a group are by definition similar to things outside of the group. The more you want to eliminate false negatives the more likely you are to produce false positives.
Adversarial situations - any time humans are trying to trick your classifier, in other words - will always make the trade-off worse.