Workers becoming much more efficient -> increased competition -> less workers that can make a living on the thing.

Which is, for the record, just fine: The US has full employment and there is lots of stuff to do. No need to do things that can be handled by machines.