This was my suspicion. It just seems like a glorified image similarity search instead of a real reversal of the stable diffusion process.