"Growth" has absolutely nothing useful to say about "things getting better for society."
Things get better for society when jobs pay well, high quality education is freely accessible, talent and creativity are rewarded, cost of entry for entrepreneurship is low, and ecological support systems are stable.
There's nothing even remotely difficult about measuring these factors.
"Growth" is just a convenient way to disguise increasing inequality and decreasing economic freedom for the majority of the population.
If the growth is never distributed it's a useless metric.
Low interest rates are fertile soil for inequality. If I can just buy Certificates of Deposit and live off the interest, instead of having to invest directly, that seems to me to be more egalitarian than less. Low interest rates brighten the line between us ordinary people and professional investors.