It seems to be true economically. Take a look at the communities built post-WW2. The homes are tiny. As wages increased, people didn't reduce the % spent on housing, they increased the value of their housing so that the % stayed the same.
I have a colleague at work who is the sole breadwinner in his family. His wife home-schools their 7 (yes, seven) kids. He earns $75K if he gets a lot of overtime. He has substantial retirement savings. It can be done. Of course, he buys steers from 4H, raises and slaughters them for meat. He penny-pinches like crazy (not unlike my grandparents).
I think a big cause of human suffering is the built-in human psychology that you always have to work to make things better. Of course, humans never would have reach the level of wealth (in the broad definition) without that drive. However, it also leads to a lot of suffering as people who are very well off (the vast majority of the US) lament their unfortunate circumstances.
Homes were much smaller and had many fewer amenities. In the U.S. home sizes have doubled since the 1950s, at the same time the family sizes have declined. My house as originally built in 1949 was about 800 square feet and had one bathroom (of a size that would qualify as a "3/4 bath" now). That was for a husband, wife, and three kids. It's had some additions over the years that bring it up to 1100 square feet, but no one would consider it a "large" house. It's okay for just me, though.
Families had one car at most. Kids in previous generations didn't need thousands of dollars in electronics and sports gear to keep themselves entertained, nor did they have (e.g.) orthodontics or other expensive (but elective) medical procedures. Vacations didn't involve trips to Hawaii.
I'm not saying that these are bad things (in fact they're largely good), but neither are they cheap.