If it were just an average, we'd only get gray sludge. Models learn the manifold distribution - they don't just mix existing works; they discover the hidden rules by which those works were created. This is reverse-engineering of human culture, and that's exactly why control over the latent space is so critical - otherwise, we surrender culture to an algorithm that has "learned the rules" but has no concept of meaning