These thought experiments are very interesting and thought provoking. But - still - it's a mathematician asking if something is alive/human. Not the most authoritative source on the subject matter.
The original computers were women in warehouses calculating actuary tables. They had a set of criteria to perform evaluations of numbers.
In short, you can reduce a subset of the human experience to algorithmic emulation, which, in effect, reduces a human to a computer. It's sort of what it means to do any job to be frank.
> In short, you can reduce a subset of the human experience to algorithmic emulation, which, in effect, reduces a human to a computer.
You're underestimating everything associated with being human. The computer won't make mistakes because a familiar is sick. He won't perform slower than usual because he slept less. He won't have a urge to poop affecting is performance, also. This is somewhat what I meant: these thought experiments are interesting, but if you look closer there's really not much to them. Human computers were, of course, computing. They didn't, however, became "not human".
Race conditions cause mistakes. Seems similar to having your mind elsewhere.
> He won't perform slower than usual because he slept less.
Didn't clean up memoery so now your computer is resource starved and running slower.
> He won't have a urge to poop affecting is performance,
GC pause.
I feel like people often focus too much on the "implementation" when it comes to consciousness. Beyond what instinct gives us, which is really just a pre defined set of conditionals, everything we know and understand is learned, programmed in a way. I don't see why it's unfeasible that given enough time and the right environment that an AI could do the same.
> Beyond what instinct gives us, which is really just a pre defined set of conditionals,
I don't think even neuroscientists have a definite answer to this. However, computer people - as always - do. That's, I think, the problem. A KISS approach is great; being oblivious of complexity isn't.
I don't think computer people think they have the definite answer, it's just easy to apply familiar abstractions to things when they map well. Plus https://en.wikipedia.org/wiki/Fixed_action_pattern seems quite like a conditional to me, and neuroscientists seems to agree. Comparing things at a higher level doesn't mean being oblivious to the lower levels, it just means it's outside the scope you care about. If we could 1:1 replicate every single possible input/output/decision/etc that happens in the human brain with transistors and have the exact same properties as a human when interacting with it, does it really matter if the path to get to those interactions is different? To me, it doesn't. We don't define people by which neurons fire in their brain, we define them by the actions and decisions those chemical reactions cause, and I don't see why it should be any different if they're made of silicon.
So you'll consider it impossible up to the point when such a machine exists?
No one says it is impossible.
It is more a question of whether our current efforts are enough to get us to the point.
Can we get to another galaxy? Probably, if we have enough resources and we discover enough to do it, and we actually go through with it. But it can seem unlikely, even given an unlimited amount of time.
Not to mention that we as a species may be facing a severe catastrophe in the future as a result of how we have populated this planet in the last 200 years. Hopefully we can avoid it, but once again are you sure?
I don't find it hard to assume that algorithms will one day be able to write posts that an observer may classify as seeming to be heartfelt.
But that doesn't mean that the machine actually experienced anything in writing it. That it's "heartfelt"-seeming post was actually felt by the algorithm at all.
"This is literally the point of Turing's thought experiment: if a machine gives you answers indistinguishable from a human, is it alive?"
Turing assumed it was. I think the issues are orthogonal. If it is indistinguishable by a human, all that means that I can see is that it's a very effective mimic, not that it has awareness.
Do you think that everyone reading that experienced it as heartfelt?
Did you have the "awareness" that it was heartfelt from birth, or did you only know that because you can recognize that it's much like other writing described as "heartfelt", that is, is it something you learned?
If you did in fact learn it, which I assume you did, since we're not born knowing language or even what heartfelt means, why do think that an AI couldn't learn the same? Do you think that how you "experience" it is universal to all humans? Or does it come from things you've encountered in the past.
Regarding your argument about being aware of the color yellow upthread, have you asked someone that is red-green colorblind how they tell the difference or how they experience red and green? It's clearly not the same as people who can see the full "visible spectrum", so do they not have awareness of those colors?
In the past when I asked a friend of mine who is red-green colorblind how he can distinguish the difference, he told me it was because he'd seen things people call red or green in the past. I asked if it was the same as the difference between colors, he said yes, but more like the difference between teal and a slightly different teal. So if you were never told what yellow is, would you be aware of it, or just know it as a slightly different orange? Personally, I know what colors are only because I know what other things of the same color look like, the same wavelength hits my retina so I know that it's the same color. How is this any different from an AI recognizing that?
Because I wrote that original post, and I had experiences while writing it. I know that from direct observation and I don't need other evidence.
"Regarding your argument about being aware of the color yellow upthread, have you asked someone that is red-green colorblind how they tell the difference or how they experience red and green? It's clearly not the same as people who can see the full "visible spectrum", so do they not have awareness of those colors??"
Yes, I was wondering if someone would bring that up, but my point wasn't that they have the exact same experience of yellow as me, but rather that they have an experience of a color (or sound, or taste, or anything) at all. And sure, some people experience fewer colors. That doesn't change the argument.
"I asked if it was the same as the difference between colors, he said yes, but more like the difference between teal and a slightly different teal." Interesting!
Well I said "a" heartfelt seeming post, not that specific one. If an AI told me the same thing, what difference would that make? I have nothing but the word of the author. How do I know you're not just an AI, and does it make any difference if you used neurons or transistors to come up with the concepts expressed? To me, the difference is meaningless.
> but rather that they have an experience of a color
But what defines that experience? Is it not just a wavelength of light hitting your eye, and your brain interpreting it?
I also find it interesting that you addressed the questions that were easy to refute, and left most of them unanswered. I am genuinely curious on your thoughts, as I find your conclusions as mystifying as you find mine.
EDIT: > And sure, some people experience fewer colors.
Ah, but do they experience fewer colors, or do they experience them differently? Since the wavelength of a color isn't what defines experiencing it, then what does? And surely you can't say they don't experience it just because of the wavelength.
This question was asked and answered concerning blue and green:
"The Himba tribe from northern Namibia, for instance, does not classify green and blue separately, the way Westerners do, but it does differentiate among various shades of what we call green. And when tested, members of the tribe, who are likely to have trouble with blue-green distinctions that most Westerners make easily, readily distinguish among greens that tend to look the same to Western eyes."
http://6thfloor.blogs.nytimes.com/2012/09/04/its-not-easy-se...
This is literally the point of Turing's thought experiment: if a machine gives you answers indistinguishable from a human, is it alive?