More to the point, I don't buy that a higher false positive rate isn't worth it in this application. From a social perspective, the inconvenience of the false positive rate seems so small as to be impossible to measure on a scale weighed against the harms of uploading revenge porn.

I know the companies are optimizing for other metrics where the inconvenience might be measurable but I think that's a failure of regulation then. The platform could be made liable like we do with copyright material, for example, and then like YouTube they would be incentived to accept a higher false positive rate and automatically filter repeat offenders out.