First, there's the drive for status. No matter how rich everyone is, demonstrating that you're slightly richer (usually to obtain a mate) is deeply ingrained in our psyches.
Second, there's the historical precedent that people have been wrong about the "problem of overproduction" since the start of the industrial revolution. They continually fail to appreciate how wealth creates new demand, which creates new wealth, which creates new demand.
Third, we rich westerners are walking existence proofs that at least X level of per capita consumption is possible. While this doesn't prove an unlimited cap, is proves a cap much higher than what the world has today.
> I think that it is possible that the work of a small proportion of the total population could provide for the whole, with the right degree of automation.
I'm not disagreeing with that statement. In fact, we've already achieved what you're describing. If you told a farmer in 1850 how productive the farmers of 2012 would be, he would assume that most of us are unemployed, because we have in fact reached the point where a tiny fraction of the population can use automation to "provide for" the whole. But of course we've invented entirely new forms of economic activity to keep the rest of us busy now that we don't need to all farm.
I'm arguing that the same process is happening to wide swaths of our present economy.
When the largest unmet need, the limiting factor for everything else, is income, how do you make a profit selling it to people?
To the extent that anyone can master the new digital tools, there will be profitable work to employ them. There's no cap on the number of possible jobs. A sudden increase in the number of people with technical skill would cause entirely new industries to become possible.
So it all comes down to skills and education. The education system we have is nearly the exact opposite of what we need. I fear that it has permanently damaged large swaths of the population by conditioning them for rote factory labor (the purpose for which it was designed) in a world that doesn't need it anymore. The pain of this transition is going to lead to nasty political problems.
Most people do have the raw potential to do the kind of challenging work that pays handsomely in the digital world. They just get it beaten out of them at a young age.