Re:Some notes on the Stable Diffusion safety filter
by ben_w on Friday November 18, 2022 @03:11PM
(#33661343)
Are you assuming that digital images are evenly distributed over the set of all possible 256 bit vectors?
Because I don't think that's a reasonable assumption.
Even if image recognition was perfectly solved with no known edge cases (ha!), when an entire topic is a semantic stop-sign for most people, you can't expect the mysterious opaque box that is a guilty-enough-to-investigate detection mechanism to be something that gets rapid updates and corrections when new failure modes are discovered.
Because I don't think that's a reasonable assumption.
Even if image recognition was perfectly solved with no known edge cases (ha!), when an entire topic is a semantic stop-sign for most people, you can't expect the mysterious opaque box that is a guilty-enough-to-investigate detection mechanism to be something that gets rapid updates and corrections when new failure modes are discovered.