It's one of the core things missing from our current AI path. Even if the LLMs reach 100% parity on human computational power, we humans are still acting as the ghost-in-the-machine, mediating and directing said computation.
If the latter, why do you think it can not? It's a configuration of particles that will evolve by physical means (under materialism ofc). It shouldn't require anything special like any inanimate object doesn't require anything to continue physically existing, the only difference being just how less complex its reactions are. And even that is subjective and anthropecentric, cause laws of nature don't care more about us than e.g. about a rock, they just work.
LLMs can handle everything downstream from that beautifully. But until we have some way to hand them a conscious experience, they'll need direction from an entity that has one.
We may be not a single mind, but a bunch of minds. It just happens that the mind that “you” are reads this and has written the above comment, cause it’s of that kind (just like “all biological beings in this thread happen to be humans” type of a filter). Other minds can live completely different lives, just inside the same skull. And share emotions and thoughts with you sometimes from their prison.
This “aware” part is pretty mysterious, because the physical mind could operate without it perfectly. But for some reason, the space containing a mind experiences this awareness thing.