If we had the same gross economic output and the same population, quality of life would be the same, aside from environmental changes.

And on the time scales we're looking at here (millions of people losing jobs within a decade or so), population growth is not a relevant concern, and does not explain why people are worse off despite more automation. Not to mention that population growth is already negative in most societies most affected by automation.