I think yeah, it's easier to use masculine/feminine. Something like long hair, soft skin, pink cheeks, more curves is feminine. Someone with more squares/edges (jaw, cheeks, shoulders) is more masculine.

Humans have trouble with this too, e.g. many crushed on Taylor Hanson.