This argument also justifies not hiring women if you consider a female perspective (whatever that is) to be less valuable.

I would rather reject the premise that someone's perspective is a function of their gender. Not least because it would concern me to find myself sharing a premise with sexists.

Furthermore, if you want to hire someone with a particular perspective, using gender as a proxy for it rather than testing if the candidate has that perspective directly looks like poor hiring practice.