In any case, it does at least care about the appearance of the actual objects. So I think it would be fair to say that there are aspects of the actual objects that the network doesn't care about, but there are also aspects that it cares very much about. Thus it's not "wholly unconcerned with the actual objects".
https://en.wikipedia.org/wiki/Chinese_room
Dalle is very concerned with the 2d shapes of things we call objects, and has correctly inferred some rules about those shapes, but it neither knows nor cares about the things we call objects and how the shapes it has learned are representations of them. It doesn't do reasoning about the round peg fitting in the round hole. It just glues a few pegs and holes together in a way that's mostly consistent with our expectations and says "is this what you wanted"?
Its a student that cares about passing the test, not learning the material.
I care that my car is quiet and has comfortable seats, I don't care (or know) what material the muffler is made of, but somewhere there is an engineer who cared about that.
A road designer cares what the tires are made of and how much it weighs, but doesn't care what color the paint is.
An AI recreating an image of my car would care what color the paint is, but not how comfortable the seats are.
I think I see what you're describing - the AI has a very limited scope and doesn't know or care about most of the things we do - but I think that's just a limitation of our current small models and limited training data, not an inherent limitation of neural networks.
DallE doesn't really have a system of the semantics of objects. It doesn't know why it would be useless for a building to have all the doors on the 2nd level. Its not even clear that DallE makes use of discrete "objects" in its limited understanding.
Here's an example from budget DallE
It understood the shape of "stick figure" and "boobs", but had no understanding of what a stick figure is meant to represent and thus where it should place the boobs. The results are hilarious. I'm not sure which I like more, the guy with a boob casually walking down his arm, or the lady with a boob head that's shrugging with uncertainty.
Notably, this precisely describes humans too. We don't know the "true" properties of anything we interact with. We just have models - some more sophisticated than others - but only to the extent that we care for reasoning about the objects. From "This stone is too heavy to lift." to "Oh yeah Becky is always late."
- Your visual system only has access to the 2D geometrical properties projected on your retina. The properties are correlated across images, inexplicably. (I certainly cannot explain how chairs are, in a fashion that includes all chairs I've encountered and excludes anything I've encountered that is not a chair)
- Any other interaction is also a correlation.
- Humans don't have access to the laws of physics, just reasonable approximations in certain contexts.
For starters you just don't look at things, you're embedded in the world. You have sensory input far beyond visual information, you also have something akin to cybernetic feedback in response to your mechanical actions in the world, and DALL-E has not.
In fact DALL-E doesn't even have access to visual information in the same sense you have, which is to a large extent biochemical and analog, not digital.
We have accurate causal models of our own bodies, and are directly causally active in the world so we can create experiments which enable us to discover its properties.
We do not live in a schizophrenic nightmare, forever trapped just to correlate pixel patterns. The claim that we do must, imo, now strongly be labelled as pseudoscience.
This is the new homeopathy; and AI/ML based on it is a scientific fraud.