Hmm, I tend to think that what one can do with some objects is an essential part of what they are.

Two-dimensional vectors can just as well be thought of as points in the plane. What sets complex numbers apart is eg that we define complex multiplication of them.

A more general example: a group is not just some set G, but that set with a binary operation satisfying certain axioms.