In some sense img2img can already do this, I have seen enough artists trying to leverage img2img in their creative process (as opposed to txt2img, which really seems only useful for ideation).