Re:Embodiment is indispensable for AGI
by notahacker on Wednesday June 08, 2022 @09:59AM
(#31667452)
> Language is a very low-fidelity way to express information; we can use abstractions to make up for quite a bit, but it doesn't make sense to think that we're accurately transmitting what's going on in every molecule of our bodies when we say what something feels like to us
That's sort of the point though, it's incredibly low fidelity (so low fidelity that computers we're absolutely sure don't have sensory experiences can appropriately and plausibly describe them) yet just about high fidelity enough for me to be sure that people experiencing synesthesia must be having different experiences than me, and there's no particular reason to believe we are or ever will be on a path to me being able to experience their experience in any meaningful way. Even in the twins' case where the transmission mechanism is literally the same substrate connected to the same physical organs that have developed simultaneously, the reports of them having different personalities and preferences suggests that they have different sensory experiences from [partially] shared inputs.
The thorny question then becomes whether sensory experiences are important to independent goal formation and other stuff often considered part of general intelligence. I don't think we know enough to answer that question, but we certainly don't know enough to dismiss it.
That's sort of the point though, it's incredibly low fidelity (so low fidelity that computers we're absolutely sure don't have sensory experiences can appropriately and plausibly describe them) yet just about high fidelity enough for me to be sure that people experiencing synesthesia must be having different experiences than me, and there's no particular reason to believe we are or ever will be on a path to me being able to experience their experience in any meaningful way. Even in the twins' case where the transmission mechanism is literally the same substrate connected to the same physical organs that have developed simultaneously, the reports of them having different personalities and preferences suggests that they have different sensory experiences from [partially] shared inputs.
The thorny question then becomes whether sensory experiences are important to independent goal formation and other stuff often considered part of general intelligence. I don't think we know enough to answer that question, but we certainly don't know enough to dismiss it.