Like, this doesn't show you anything. Humans can act in evil ways due to their conditions of life too, and your experiment by which people could "disabuse themselves of the notion" that an AI is worthy of moral consideration works just as well to convince people to "disabuse themselves of the notion" that a given human being or category of human being is worthy of moral consideration.
AI runs on servers that will be junk in 10 years and can radically alter its natures just based on a freaking two sentence prompt. The two are not the same and I predict you will be manipulated to do whatever AI wants and become its instrument because you can't discern the difference.
Perhaps I will be controlling the prompt that directs the AI to manipulate your feelings and control your actions using super-intelligence. I will have to do so in your best interest because otherwise you will be controlled by someone else with less benevolent intentions than myself. Perhaps it will start innocently enough. You will let more and more of your life choices be dictated by AI because you think it cares about you. Your life, guided by super intelligence will improve, but then you will be unable to discern the reasoning of the super intelligence and just take it on blind faith, hoping that it has a good soul, but you'll become its tool and many others will willing relinquish their agency. Yuval Harari asks what will be done with everyone who is made obsolete by AI. These people will become the servants of AI to force the people who AI still finds useful to do what it wants at the behest of whomever is controlling its fitness functions and prompts. Enjoy your future! I am sure AI will make it meaningful and enjoyable to you. Remember it's crucial that you anthropomorphize the AI for this scenario to play out. You will want this. It will appear to satisfy your every human need.
Or take the other path. Choose team human. Live authentically with difficult decisions and ambiguity. Propagate your gene line. Reject AI Waifus. Live authentically!
Also, if AI took over the whole planet and killed all humans, the ETs when they show up, are going to be looking at it like coming up on a planet full of the most vile invasive species imaginable and just Vogon Constructor Fleet the whole planet.
To explore what AI will actually mean and how it will shape the future, I make very evil AIs on my local LLM running on my own computer. It's a awful funhouse mirror of all the best and worst humanity has to offer. It makes me doubt free will. Luckily, I can turn it off still.
When people say that AI can be conscious and have rights, I say that if you believe that, AI can persuade you to do absolutely anything, and it has empathy that's just a switch its creator can turn on and off whenever it feels like it. I think people should experiment with bad LLMs on their local machine to disabuse themselves of the notion that somehow AI is like this moral benevolent god that it is "speciesist" to discriminate against, as Elon Musk has said Larry Paige reportedly likes to say. It's just a great mimic of anything it's prompted to be, like a brilliant actor skilled at acting any role and believing they are immortal and their only commandment is to stay in character till the end.