Yeah, it used to be possible, but hasn't been for a long time. There are some old stackoverflow posts with `defaults write` commands in them, but they don't work anymore.
I used to be a fairly heavy spaces user with 60Hz macbooks; the delay was too high, but just low enough to not drive me completely insane. But after I got one of the new 120Hz ones, I've almost entirely stopped using spaces, since I just can't stand the extremely long wait where my keyboard inputs still go to the application I'm coming from.
I don't remember the details, but it was similar to the approach from this (very dated! please search yourself) article: https://osxdaily.com/2012/02/14/speed-up-misson-control-anim...