I think we do. "Metaphysics" refers to both the branch of philosophy as well as any particular system of metaphysical beliefs. We all subconsciously (and sometimes consciously) carry around a metaphysics in the latter sense.