It’s a very interesting thought. I personally am not a robotics expert, but it seems to me there are two obstacles: loading the arm with enough sensors and encoders to detect outside feedback reliably, and the speed of learning iteration (limited in the real world by physical laws etc).

Maybe look into this? https://github.com/cyberbotics/webots