i agree. i don't find the term lifestyle business demeaning.
i've had some lifestyle businesses in the past that have done really well, and frankly, when you have a really successful lifestyle business, if someone treats you condescendingly, sitting at the beach drinking pina coladas at 11am on a weekday is a great remedy.
Feel free to rename it if you want, but I'll stick with the original.