Well, a part of it is that at least VSC's Vim extension is rubbish and is unusable if you don't use the defaults.

Yes, I have considered just patching whatever I need for my own keybinds, but I decided I was just more comfortable sticking with neovim.

Another part is that VSC has annoying input lag