I think you're approaching it from the wrong POV. First of all, the option needs to be on the site owner/developer side on whether to adopt AMP or not - and not have the decision of not adopting AMP adversely affect search ranking.

As a user, I should just see whatever the site lets me see. If they decide AMP is best for user experience, I would no doubt get it. If they decide to show a responsive mobile friendly site because it works best, then show me that.