Nothing wrong with it, of course, but the perception that you "aren't buying into a lifestyle" is EXACTLY the lifestyle you're buying into.
Maybe not S6 users in particular, but buyers of high-end Android phones in general absolutely are: that of being too smart for Apple and better than all those iSheeple. That's just as much a part of the Android experience as cult membership is of the iOS experience.
None of the Android phones has ever really gotten the same cachet that the iPhone does (Samsung nearly got it right with the S3) but it's down to perception and marketing.
In terms of device capability Android phones are considerably higher spec and just as usable (5.x is a big improvement) but it doesn't really matter, fashion and marketing wins out.
You see this in other areas, Sennheiser headphones are demonstrably higher quality (in sound and construction) than "Beats by dre" but if the difference is small enough then fashion wins out again.
More cores != better usable specs.
If you prefer security and privacy, there's a strong case for iOS.
If you prefer day-of-release software updates, there's a strong case for iOS.
If you prefer robust photography solutions, there's a strong case for Apple's camera hardware and software.
If you want to create audio, there's a strong case for the low latency of Apple's stack.
Android phones equivalent to the price of an iPhone have higher resolution screens, more storage and RAM.
Android phones half the price of the iPhone have equivalent screens, storage and RAM.
I have Nexus devices so I get day-of-release software updates (even my Nexus 7 2012 is running 5.1.1)
I couldn't care less about photography solutions or audio so that really doesn't apply.
Privacy, agreed, Android is a data hoover out the box.
That said, it has been less than 4 years since the iPhone 4S was released; they shouldn't be failing yet, and that reflects poorly on the iPhone (as well as iOS) in your case. However, I'm also not yet convinced that the Nexus 5 will be operating well in late 2017 - that's yet to be determined.
People who are purchasing the S6 aren't buying into any lifestyle as far as I can tell. Maybe they'll share a common bond with some other S6 users, but I wouldn't call the Samsung ecosystem (what is the Samsung experience even?) luxurious. It takes more than just one product to build luxury and desirability.