Those are subjective clarifications, and so will differ between each person. And models are pre-trained to recognize these classifications.
Since you mentioned war, I'm reminded of Black Mirror episode "Men Against Fire", where an army of soldiers have eye implants that cause them to visually see enemy soldiers as unsightly. (My point being this is effectively what Facebook can do.)
Re:Facebook Ban on Linux
by maybesomaybenot on Monday January 27, 2025 @06:57PM
(#42847295)
You assume automation solves the problem. If it did, Facebook wouldn't be hiring close to 100,000 humans to inspect content.
Automation + human intervention, yes. In the setup I described, worst case scenario something gets blurred out that's benign, but it doesn't create a press/support nightmare for Meta.
Considering they've open sourced one of their image detection API [1], I'd imagine it's more a problem of accuracy and implementation at scale than a serious technical hurdle.
If it's something trending towards illegal, toss it into an "emergency" queue for moderators to hand-verify and don't make it visible until it's been checked.
So in your example, if someone uploads war imagery, it would be tagged as "war," "violence," "gore" and be auto-blurred for users. That doesn't mean the post or account needs to be outright nuked, just treated differently from SFW stuff.