It's not uncommon, I don't think. A lot of people have trouble with faces (in various ways, and to various extents) despite having otherwise "normal" visual processing and memory.