> We don't care what animals in the zoo think.

Tangential to AGI, but don't we? Vegans seem to have quite a strong opinion on this assertion.

I spend a lot of time looking at the various primates and cuttlefish thinking very much about what they "think" and whether we could even conceptualize the self-awareness experience they seem to have.

It seems possible that we could eventually gain a better understanding of the intelligences of other species, but at this point most of our consideration of them is a fashioning of mirrors to better examine ourselves. This self-regard was the original purpose of zoos, and it still explains much of their existence.

It's not just intelligence, it's also speed. If you update your world model fast enough, eventually people just look like trees.

Good point! Or to paraphrase Mad Men…

Humanity: I don’t think your intelligence matches that of a human’s.

AI: I don’t think about you at all.