I will for sure be using the SSH straight into Tmux trick. To get it to work I had to add a RequestTTY option in ~/.ssh/config.