He didn't say money didn't matter, he said that's not why he moved to Silicon Valley. i.e. it's not his top priority. Yes, it's a position of privilege, but he's allowed to have differing priorities from someone who is struggling.

Once you have enough money for basics and contingencies, yes, happiness is more important.