I have absolutely no problem - even prefer - having a surgeon with 40+ yrs experience operating on me via a robot device that removes any tremors from old age. Their experience is what matters.
I think robot enthusiasts sometimes underestimate what hands attached to a brain full of knowledge really are capable of.
There's a problem software developers have to solve if they really want robots to be a full replacement for a human physically performing a task and that's a way for the trained humans to communicate their knowledge to the robot. The problem with this is that most people really aren't great at communicating precisely. They have a hard time teaching each other and are often hopeless when it comes to giving precise and complete instructions for something to a robot. forget complex tasks like surgery even gardening and washing dishes is hard. Even something as simple as "grab the thing" is a pretty big project.
Maybe in the future as robots become more common speaking with the level of precision required will also become common (kind of like what happened to culture with the web and email.)
While OP is talking of robotics as an assitive tool to help a surgeon make finer or less invasive movements.
I was in a lab testing a new product on the da Vinci Robot and one of the surgeons commented to me that "this robot will add another 10 years to my career" -- he was probably in his early 60's already! It will be very interesting to see how robotic technology changes surgical outcomes as robotic surgery becomes the standard of care.