Isn't this exactly the opposite? Read Aristotle or Aquinas and they have all kinds of definitions about why humans are fundamentally different in nature than animals; and Darwin, whose work made it much more palpable to believe that humans were just another kind of animal, did his work smack in the middle of the Victorian era.
As a counterpoint, I recommend reading Everlasting Man, by G. K. Chesterton. If humans are just animals, they're the most bizarre animal we've ever seen.
This was at the same time part of an argument against (human) slavery. "The French have already discovered that the blackness of the skin is no reason a human being should be abandoned without redress to the caprice of a tormentor. It may one day come to be recognised that the number of the legs ..."
Quite apart from the suffering being a supposition (essentially based on the "duck test"), this leaves unaddressed the question of why the ability to suffer should confer rights. Elsewhere he makes the point that adult animals have more morality than similarly aged humans (toddlers), which is at least in the same ballpark as the idea of rights. But I don't think we even know why we grant creatures rights.