If we build something one day that acts like a philosophical zombie [1] for example, then yes topics like self-awareness, consciousness, theory of mind will all be at the forefront of conversations regarding AI. But right now all we have are algorithms that optimize towards a goal and we have journalists jumping in on the hype talking about robots inventing languages, the desires these robots have, and robots teaming up to destroy humans [2].
[1] https://en.wikipedia.org/wiki/Philosophical_zombie
[2] https://www.maxim.com/news/elon-musk-artificial-intelligence...
Here is my problem:
I am defining consciousness here as a feeling of existence. It does not necessarily entail strong self-awareness to the extent that humans have.
You have this kind of consciousness. Correct?
If you have consciousness, then we can assume I have consciousness as well. That is something I hope we can agree on, unless I am one of your philosophical zombies, in which case you are a solipsist and a true hardcore Empiricist, which is completely fine, but in that case we can unfortunately move no further.
Assuming I have consciousness, I ask you, does the average intelligent primate have consciousness?
Assuming so, does the average dolphin have consciousness?
Assuming so, does the average sheep have consciousness?
Assuming so, does the average rat have consciousness?
Assuming so, does the average lizard have consciousness? Do we lose consciousness here?
Does the average insect have consciousness?
Does a tree?
Does my houseplant?
Does a microbe?
Does my computer?
Does my thermostat?
Does a home?
Does a lake?
Does the universe?
Is there a line somewhere here that separates the conscious from the unconscious?
If there is, can we prove it, or is it as elusive as Bigfoot?
If we can't prove it, and the burden of proof lies on the thing being posited, then I have one final question: Why believe in the line at all?
I don't necessarily have an argument for either of them right now. But you asked me "why believe in the line at all?" -- I'm not making an argument for what consciousness is, I'm only claiming that the current state of the art algorithms we have developed and AI we currently build have nothing to do with topics like self-awareness, consciousness, theory of mind, etc. One day we'll get there I'm sure.
Just like you are doing exactly what you were programmed to do by your DNA.
The self-awareness is a strange loop where the program itself encodes a simplified model of itself within itself.
That's all self-awareness is. Meta-information. Humans just have REALLY GOOD meta-information that rolled off the evolutionary assembly line over billions of years.
It almost sounds like you're positing a magical `soul` that comes in at some point, and for some reason it will only inhabit squishy wet bio-machines like us but not hard metal-machines. You're not doing that, are you?