That's a fair point. I do think that we essentially live in a world that is built up largely out of psychological/social constructs and mental abstractions. In a lot of ways, a psychological or social construct can be a lot more "real" than the "raw" universe (which I don't think can be perceived directly and is more of an abstraction). Therefore, I think it's often more useful to look at the world as it is experienced by people, rather than how it "really is".