But that has the problem of "computer recognizes 'car', asks fleshy meat-bag to point at 'car', sees meat-bag point at 'car'".

It doesn't learn anything about the environment from that, so to me it doesn't change anything.