That's pretty much what this is. I have a git repo with one dir for everything that needs configuration. Whenever I spin up a vps/vm or what have you, git clone dotfiles; cd dotfiles and stow what I'm using on that machine.

stow links based on the directory structure of the folder you're calling, so I don't have to worry about where things are, just stow fish; stow nvim

There's no symlink script or adapter script to work with stow, everything 'just works' for me.