This depends on the algorithm. There are some public algorithms that get crushed by things like facial hair, glasses, etc.

The better the algorithm the harder it is to spoof. But some of the older/crappier ones can be defeated just by tilting your head to the side.

This is my understanding and when I was playing around with some algorithms it was a grading metric for the algorithms.