If handiwork and producing or finding your own food is what makes you happy, then why does it matter whether you are outsourcing to society?

The second sounds like a separate goal unto itself. There's absolutely nothing wrong with that goal, or with having multiple goals, but if you start by saying doing X makes you happy then it doesn't really make sense to say doing X won't actually make you happy because you aren't doing Y.

People don't have the physical or mental ability to live alone. Their version of "alone" is a world where there are institutions that exist to protect their property, guarantee their transactions, and where they are supplied with a massive amount of high-quality manufactured goods. Paying for them doesn't make you somehow independent of society, it's the nature of society. You're trading bits of paper with government promises printed on them.

There's a big difference in living alone versus living in a big city though. Living in a cabin in the woods, as the example here, doesn't mean alone and cut off from everyone else. It likely just means a quieter, more self sufficient life.

Presumably if one is actually living alone in the woods they wouldn't be dependent on the larger societal systems like money, security, manufactured goods, etc. How would the get the money to start with without having a job that interacts with the outside world?

I think the point is more that there are a very limited number of very specific lifestyles that can exist outside of a society. If you happen to thrive in one of those lifestyles, awesome, cabin in the woods works great for you.

But you can't do that if your passion is making music, or mathematics, or computer programming, or electrical tinkering, etc. There just isn't an option to follow the vast majority of pursuits except if you also engage in society.