Why fixate on the face and not, say, our hands or body, if they might be afraid of us, to determine if we are a threat? Eyes must provide a higher signal of intent, so it's surprising that even animals on a much lower level of intelligence can read our facial expressions.
I'm not sure if it's a good or a stupid question.
The face and eyes indicate intention. You can't successfully track or kill without focusing your full attention on the object, and the easiest way to detect this is by seeing where the eyes are focused.
Once a threat is determined, then focus moves to other body parts.
Think about it this way how can you kill successfully if you don't have a basic understanding of the anatomy of what you're trying to kill?
I think a general body map is hardwired into more vertebrates. Heads always have eyes, ears and move around. Arms are on the upper torso and legs are at the end of the torso, tails are common.
Beyond that level, your guess is as good as mine though.
It's precious.
Your friends will think you're crazy, but cats will love you.