Tmux solves this problem for me. I don't use the VSC integrated terminal at all. I have its scrollback buffer set to 1.
The reload isn't bad for me -- it even keeps my text editors open with undo history. I'm not sure if I had to do something to enable that. There is probably a way to make it retain the integrated terminal, too (though you should really use tmux, it's awesome).
VSCode added the ability to restore “local” terminals after a reload in the Feb update: https://code.visualstudio.com/updates/v1_54#_retain-terminal...
I’m guessing that doesn’t work for remote terminals though, I haven’t tried it.
Seconding what the other guy said though, tmux is perfect for this. If you use the iTerm2 tmux integration you don’t need to remember all the commands to switch tabs, scroll back, etc, it just feels local just like VSCode.
I know not a big issue and I could use tmux, but I'm lazy.