Looking at pictures of Churchill, who was admittedly a bit after the Victorians but seems to have followed a somewhat similar lifestyle, he doesn't exactly strike me as skinny.

I imagine they did have a fair amount of obesity in the older members of the population, although it's also possible that the sportier ones (which I'm guess would have entailed things like polo and horseback riding) would remain fit into old age.