It doesn't have to be exact, no more than your input to Dall-E should be exact. Give the AI some understanding of intent of the project, some automatic metrics that will check AI's job quality and let it optimise against it. If AI doesn't generate what you wanted on the first run, correct it and let it learn. Basically what you would do with a junior developer.