Maybe the difference is I'm not vegan or vegetarian for philosophical reasons, purely health reasons.

I don't really care what the label is to be honest, it's just how I eat.

Vegetarian is probably closer to being more accurate. But then again I will happily order a steak at a restaurant. So maybe I don't deserve any of these labels at all :)

A better way to put it is I prefer eating vegan rather than I am vegan