Re:Three arguments against the singularity
by loup-vaillant on Wednesday June 22, 2011 @10:13AM
(#2683168)
Eliezer Yudkowsky has a very good synonym for "AI" that doesn't trigger anthropomorphism: "Optimization Process". An example is Darwinian Evolution. And it is quite obvious that Evolution isn't alive, sentient, let alone human-like.
Good old evolution. Humans are just one of its fruits, yet we think so highly of ourselves.
If a superhuman AI exists, exactly what evolutionary niche are humans going to fill? Because there's a word for species which don't have an evolutionary niche: extinct.
"It seems that conceptualizing AIs as human-like is the #1 top mistake that leads people to think AIs are impossible (or, alternatively, safe once they're built). It's more enlightening to think of an AI as a cold mathematical machine"
But really, even humans are just cold mathematical machines when you get below a certain layer.
We're mathematical machines but we're anything but cold. I'm quite warm, thank you very much.
It seems that conceptualizing AIs as human-like is the #1 top mistake that leads people to think AIs are impossible (or, alternatively, safe once they're built). It's more enlightening to think of an AI as a cold mathematical machine that uses computational power to achieve whatever goal the original programmer specified, possibly increasing its own power in the process. It will happily eat your babies if it needs more atoms. Its lack of personhood won't save you.