You're arguing for familiarity in tactful design, while I agree that for most users this is a good thing, repeatability of existing patterns does create that immediate familiarity.

HOWEVER, that familiarity is only a virtue because someone, once, deviated hard enough that their deviation became the new familiar. AI can only optimise toward the current snapshot of "familiar". It cannot produce the next one. If designers outsource all their thinking to a model even in tactful design we would never have groundbreaking design concepts like "pull to refresh" or the command palette.

> someone, once, deviated hard enough that their deviation became the new familiar

That’s not necessarily what happened though. Apple innovated not out of sheer daring but because they also had the best metaphysical paradigm for GUIs that people could also just intuitively grasp. There was a structural correctness to their approach, underlying all the things that we find visually appealing. In the beginning, Google dared and deviated hard from Apple’s design language to establish their own unique identity, but anyone who’s working in the mobile space would Have noticed that Android coalesced into roughly the same patterns over time because of that structural correctness.

>Designing a user inteface involves thousands of small decisions. When trading off pros/cons for each of these decisions…

Which needs to be done intentionally in context, not homogeneously as a rapid output of a generative tool.

When you aim for familiarity you also make the assumption that someone else's judgement and opinion was and is the correct one, when you question the assumed only then can you make meaningful improvements. See the iphone which was totally different to the "standard" phones of its time.