I agree partially. So long as the word means 'that thing VCs won't invest in,' it's demeaning.
But lifestyle business is inherently demeaning. It implies a goal of cutting back on stress, hard work, long hours etc. A retirement business. A B&B.
Since most of those it is applied to (in this context) do not have these goals, it is insulting. Like calling a punk rocker adorable.
The thing is that it's not what VC's won't invest in that needs a name, it's what they do invest in that needs one. For one thing, an exit plan is something the majority of businesses do not have when they start.
Picking a new name will shift the implication. See "euphemism treadmill":
http://en.wikipedia.org/wiki/Euphemism#The_.22euphemism_trea...
Whatever new term is picked, no matter how initially flattering, will -- when repeatedly used in the same contexts -- eventually adopt the same connotations of 'not good enough for bigtime purposes'.