I also don't see how your final paragraph really refutes rather than just restates their opinion. Hobbies produce projects and business ventures all the time. Someone also has to find some way or another to socialize with the community. Volunteering is a great way to do that.
If I have to do a job I hate for the rest of my life I would eternally be low energy. If I could do the thing I loved every day, the thing I truly wanted to do, I would get up excited every day and would have high energy throughout.
Having more free time, yes people would get bored. But the resulting things that they work on would be things that invigorate them.
Hourly employees have it even worse. When your schedule varies week to week and even on your "day off" your employer may be constantly reaching out trying to bully you into taking another shift, it's very hard to maintain regular non-work activities. Perhaps you have friends who work similar schedules to you, but good luck going to a sports team or club that meets Thursdays at 6 when you don't know if you'll be available then until 12 hours before if ever.
(I'm not thinking of a making-money-from-my-hobby side gig, but an actual business.)
You can do a side-hustle in spare time, but an actual business, one that pays salaries every month takes enormous effort.
I don't buy this construction of the workday where spending 50% of your awake hours at work leaves people so exhausted they can't do anything else with their lives, but if we changed that to 38% of their waking hours they'd be so bored that they be starting businesses and volunteering all over. That's not even consistent with your own experience of being exhausted halfway through the work day. Two extra hours per day isn't going to translate to launching a new business or volunteer effort.
You hinted at the real problem: Most people don't have the time management skills and motivation that they think they do. Remove a couple hours of work per week from most people's lives and those hours will get redistributed to mostly leisure time. Some of it more productive than other options (socializing with the community, working on hobbies).