Don't know why you're being downvoted, it's obvious you are right. "AI art" is a style transfer and NLP tool. It doesn't exactly produce visual work with meaning, other than by accident.

I think it's similar thing with hands, we immediately see the problem with the hands because we know how they work and recognise when the generated hands wouldn't work.

This expands to all kind of machinery actually. The moment you start reasoning about the output it falls apart. I only assume at some point there would be another AI model which is trained on how things work and will guide the current AI stuff.

Like the way ControlNet guides StableDiffusion to produce output the way the user desires.

It also happens with human artists.

Artists are trained in things like perspective, shadows, etc... They often devote a good amount of time drawing people right maybe, study basic principles like mass distribution, but they don't know everything about the underlying principles. For example, I have a painting of a harbor with a few sailboats, it looks great until you realize that sails take the wind from different directions, as if each boat had their own wind. Unless the artist really has a strong focus on realism, sometimes involving collaboration with experts in the field of what they are drawing, you are going to find mistakes like these everywhere.

It happens with human artists that don't bother understanding the things they draw. What is just a way of saying that yes, human can emulate those NLP¹ AIs, but we can choose not to. (And no, it doesn't take a strong focus on realism. Our world has all kinds of mechanics that most people understand.)

1 - We do need a name for this characteristic, because NPL AI is anything that talks with humans

I'd imagine it was rarely trained on images of random industry equipment

When I was a kid I loved (who am I kidding, I still love them) the Incredible Cross-Sections books which have exploded-view drawings of tons of machines, real and fictional. The oil rig in particular sticks out in my mind because that’s how I learned they were movable and had their own engines. Seeing all the different parts and what they were for was fascinating.

Here's the Incredible Cross-Section of an oil rig:

https://i.imgur.com/oiMObcE.jpeg

Interesting! That is not the one I remember. I did some digging and realized it was actually the “Look Inside Cross-Sections” series of books I had as a kid, though I can’t find the oil rig from there on the internet.

They of course can ---- if you know about this kind of thing in the first place. I don't really think AI can actually create new stuff -- best they can do is random sampling in some clusters, or going total cliched random, like what happens when you ask GPT to complete a <|endoftext|> token.