Disclaimer: I havent paid much attention to Japan for a decade, since my Brazilian-Japanese ex became ex. However, her family members spent a lot of years working for the second tier companies as "guest workers".
"Doing one's work" in the modern world does not happen in a vacuum. If substantial segments of the market refuse to do business with you on the basis of your age, yeah, you're not going to be quite the stellar businessman.
When performance is measured by how much money you extract from a few organizations (think government contracting, think enterprise sales, think manufacturing), institutional prejudice can become one of the primary factors determining success.
Older people doing jobs of that sort in no way means that there's a shortage of work younger people could do... unless you're implying that Japanese people are both
1) unwilling to purchase goods and services outside of large industries that discriminate against young people
and
2) incapable of creating goods or services non-Japanese would pay for
Most of the goods and services that I purchase, anyways, are enabled by some sort of expensive and heavily regulated infrastructure. Every physical object that I buy was produced by a factory and purchased at a large retail outlet. The main services I pay for are communication-related (cell phone, internet, etc. - huge infrastructure there), automobile maintenance-related, and liability-related (e.g. insurance), medical-related, and the occasional meal at a restaurant. The only ones of those that one can do as a small business are automobile repair and food services, neither of which are the first things I think of when I hear "upward mobility".
Basically every highly-upwardly-mobile profession relies on expensive infrastructure (communications), access to an enormous pool of money (insurance), good relations with government regulators (law, medicine, insurance, communications), access to a large distribution channel (retail), or manufacturing (retail). There are some peripheral service professions (advertising, real estate brokership, stock brokership), that rely on having a good relationship with a wealthy clientele, not to mention a good relationship with regulators.
Basically, upward mobility relies on existing infrastructure of some kind, and if someone who isn't you and doesn't like you controls it, you're fucked.
So, you know, they could write web apps, since no one really controls the internet. Maybe. And they probably won't get VC funding. Or get bought by a company, unless they're really profitable. Or get advertising deals.
It's only in web app land that 2) is possible without manufacturing, and the Japanese are at a steep disadvantage because of the language barrier.
Instead of hiring younger workers, Japanese companies shuffle older employees around in the company. Entry level positions are often taken by older employees who were unable to perform at higher levels. Instead of rotating these older workers out of the company, they are often given entry level positions that would normally (at least in the states) go the young workers.
I'm not sure if I'm misunderstanding your argument or not, but it sounds like you're saying that the more old people work, the fewer young people can, i.e. there are a fixed number of jobs. If this were truly the way economics worked, then it would be easiest to find in places full of lazy and/or incapable people. This isn't the case though.
As long as there exist services or makable things that people want enough to spend money on, there are always jobs to be done. Maybe the issue is in education, willingness to retrain, liquidity of job markets, or hurdles to starting businesses, but I don't believe that old people working means that young people can't.
If 99% of Japanese companies truly did hire old people into upper management who weren't as capable as younger people at doing their work, the other 1% would eat them alive.