It will only ever be a full time job if you work on it full time. Since it's your company, you get to choose the hours you work, so you can make your lifestyle look however you want it to look.
So yes, it may in fact be a hell of a lot of work. But fortunately you possess a hell of a lot of time before you die. Divvy it up any way you choose, but please don't give up because it takes effort.
The end result is really nice.
It may be surprising to you that my customers actually don't care how many hours I want to work, but only about the value I deliver to them. I don't get to wave a magic wand and work 10 hours a week and keep all my customers, though I'm sure my competitors would wish I tried.
The place I see "lifestyle businesses" working best is where the market is unattractive to larger competitors due to size, difficulty reaching clients or others. There only select markets where this is the case.
Look, I love all the lifestyle business stuff and I'm adopting some of the tactics myself, but the suggestion of this article and your comment that the hours you work is solely a matter of choice is bullshit. You have to give up something, normally money or proximity to family and friends. Or put it a lot of work upfront building a business that you can then coast on.
I think the argument here is that "value delivered to customers" and "amount of work required to deliver that value" are completely unrelated to one-another. To give two examples:
1. The biggest possible improvement you can generally bestow upon a small services business is a website (not even a fancy one, just a five-page Wordpress shindig with acceptable SEO.) This takes approximately two hours and $50 (I'm being generous.)
2. Video games are one of the most difficult software products to produce in terms of sheer SLOC, expertise required, and resources needed, and yet the value most customers assign to them ranges between $0 and $60.
What would happen to your business in you spent 20 minutes answering emails tomorrow morning then went fishing for the rest of the day? What would happen if you did that twice a week from here on out?
If the answer is yes, the business would implode within a day, is there not something you could do to change that?
There should be no question in anyone's mind that you need to wear several important hats well and do the hard work to be good at them. The determining how to scale of each of the dimensions (time, money, freedom) becomes something you can control. If you can't wear all the hats yet, you need to learn more. Half-assing someone else's affiliate site model, dropship site, etc is kind of like like trying to build an great app by cutting & pasting code from google searches. You need to learn how to code first. Same with business and marketing.
The problem with these types of posts is that they make it seem like passive income is easy. In fact it is a hell of a lot of work to create, say, an info product, and marketing it can also be a full-time job. You need to have surplus income and time to take on the risk of doing this, which is hard to do if you're an employee. This probably explains why most of the passive income stuff we read on HN comes from consultants.