On my 2019 work machine (MBP) all filesystem operations were slow. On my 2021 one they aren't. Same specs, same OS. Maybe there's some bug in the filesystem? Not sure if you can fix by clean-reinstalling or if it's tied to the hardware.