We may be not a single mind, but a bunch of minds. It just happens that the mind that “you” are reads this and has written the above comment, cause it’s of that kind (just like “all biological beings in this thread happen to be humans” type of a filter). Other minds can live completely different lives, just inside the same skull. And share emotions and thoughts with you sometimes from their prison.
This “aware” part is pretty mysterious, because the physical mind could operate without it perfectly. But for some reason, the space containing a mind experiences this awareness thing.
It's one of the core things missing from our current AI path. Even if the LLMs reach 100% parity on human computational power, we humans are still acting as the ghost-in-the-machine, mediating and directing said computation.
If the latter, why do you think it can not? It's a configuration of particles that will evolve by physical means (under materialism ofc). It shouldn't require anything special like any inanimate object doesn't require anything to continue physically existing, the only difference being just how less complex its reactions are. And even that is subjective and anthropecentric, cause laws of nature don't care more about us than e.g. about a rock, they just work.
LLMs can handle everything downstream from that beautifully. But until we have some way to hand them a conscious experience, they'll need direction from an entity that has one.
"Cognitive science" vs "neuroscience" as a concept is just how we decided to slice the problem up for academia.
Next time, maybe cut the first paragraph ;)
"... neurons that fire together wire together" (essentially)
Its the same thing with a game running on a computer. You can point to different systems for specific aspects of it. But you can't show me where, either in software or hardware, the experience of the game lives.
That said, your understanding is largely supported by our current understanding of consciousness, attention, and perception. The attention mechanism doesn't handle parallel processing well—but can operate "multi-threaded", where it juggles several foci at once (with some obvious cost to switching between them). But I think its a mistake to assume that decision making has to be done within this attention context. While we may only be aware of a single thread at any given time, the brain is doing a lot of parallel processing. We can only focus our attention on a single cognitive task, but that doesn't mean we're not actively performing many others.