Building a lifestyle business mostly rules out services as most desired lifestyle business model is some sort of passive income scheme. Content oriented monetization models are being slowly, but surely killed by ad blockers. An innovative product tailored to the needs of a small, well defined audience seems to be a best bet for a lifestyle business and that's very different from a classical SME.
I don't think passive income is needed at all, I think "lifestyle business" is a useful definition for making tradeoffs in your business decisions in favor of your lifestyle.
e.g. setting up a consulting business in a small coastal town because you like to surf every morning, even though it costs you potential business. To my mind, that's certainly a "lifestyle business".
Doing this with a product business is harder but not impossible.
I don't know about you, but personally I get annoyed when people create a false dichotomy between a startup and a "lifestyle business". Not everyone who declines to play the VC game is a "lifestyle business". It should also not be a dirty word, which is the way it comes across to me sometimes.
Each local area is a separate market. Those types of businesses have limited geographical range, and a given range can only support a handful in a specific segment. For a technology business, the market is usually not limited by geography. Fundamentally, it is the same principal: a given market can only support a limited number of players.
Now, the size of the market may preclude traditional small business growth models. It depends on how tied to locality a particular business idea is. I could see, for instance, something like Homejoy working on the scale of a single metro area. In fact, having dozens of metro-area-sized Homejoys might actually work better than a single, national incarnation.
1. http://www.tillett.info/2014/11/24/lets-kill-the-term-lifest...
"Small Giants: Companies That Choose to Be Great Instead of Big"
[1]: http://www.amazon.com/Small-Giants-Companies-Choose-Instead/...