Something about Catalina has been causing issues with both installing Xcode and massively increased phantom disk usage (not just related to TimeMachine). I didn’t experience the former (have colleagues who did though), but did experience the later and had it self correct (on a machine without TM enabled).