Re:Launch HN: Reality Defender (YC W22) – Deepfake Detection...
by bpcrd on Tuesday March 22, 2022 @12:40PM
(#30768312)
We agree. Dataset fidelity and bias are major concerns for publicly available datasets. For this reason we are working to develop programmatically created datasets along with anti-bias testing and policies.
Re:Launch HN: Reality Defender (YC W22) – Deepfake Detection...
by prometheus76 on Tuesday March 22, 2022 @01:26PM
(#30768918)
"Bias" and "anti-bias" is a slippery snake that will bite you as soon as it warms up to you.
And realistically, since deepfake detection will inevitably be more expensive than captchas or antivirus scanning, this will be adopted by human-in-the-loop organizations for critical processes where threat scoring or moderation is already being applied.
That said - Reality Defender, please train your system on diverse human data sets, do not release models where ethnicity or gender (including gender identity) are nontrivially correlated with deepfake score, and have processes in place from day 1 to allow users to report suspected patterns of bias. The kafkaesque "prove you're not a bot" scenario envisioned by the parent poster is one thing for holistic human-in-the-loop verification processes, and another thing if it suppresses minority voices and minority access to government services.