Since v1.0+ of this extension I have been constantly having issues with neovim's and VSCode's buffers got out of sync. I cannot reliably reproduce the issues however. There are a few similar reports, e.g. https://github.com/vscode-neovim/vscode-neovim/issues/1624. I've switched to other VIM extension (VSCodeVim) which I found more reliable, albeit less powerful.

That's funny, because I switched from VSCodeVim to NeoVim for a similar reason.

I guess both have issues. But still, the power of VSCode with vim keybindings is still my best setup.