I don't think people are saying fewer robots are the solution. What I hear is words of warning, to be mindful of how the resulting gains and "freedom" are distributed. The goal of is (or at least should be) to reduce suffering, not merely reallocate it.