As in, the part with producing language. I.e large language model.
"In the end, we are self-perceiving, self-inventing, locked-in mirages that are little miracles of self-reference."
— Douglas Hofstadter, I Am a Strange Loop, p. 363
https://en.wikipedia.org/wiki/I_Am_a_Strange_Loop
(Knowing nothing about AI, I have no idea how Hofstadter's philosophies have held up since.)
We have no test capable of determining whether or not they have those things, not even if we disregarded the limitations of our current technology capabilities and are only asking hypothetically how to differentiate.
We also don't have that for animals, or even other humans — I know I have an experience of being, but no way of telling if someone else who says they do actually does. I have to assume at least some of y'all do or you wouldn't have written about it since at least Descartes.
AlphaGO satisfies all of the requirements you listed for a human. Creativity, problem solving.
Just put it on a game loop, with more variables.
Humans don't just process information; they experience emotions, desires, and subjective experiences that are deeply intertwined with their cognition. LLMs don't have feelings, motivations, or consciousness.
Humans have inner subjective experience, self-awareness, and the ability to reflect on our own existence. LLMs don't.
Humans can adapt to a wide range of environments and situations, drawing from a complex interplay of instincts, learned behaviors, emotions, and rational thought. LLMs are much more limited in their adaptability, since they focus primarily on the tasks they were designed for.
Human cognition has evolved over millions of years and is rooted in a complex biological system, the brain. Yes, both LLMs and human brains process information, but the underlying mechanisms, structures, and functions are vastly different.
I really wish people would stop this sort of cavalier reductionism of humans by saying we are basically LLMs. It isn't true.