If your utilities are written as self-contained exported Bash functions, you could concatenate them all in a single file (say, `utils.sh`), with a single line at the end:

    exec /bin/bash

Then you could do something like:

    ssh hostname@address -tt bash -s < /path/to/utils.sh

And have all your utilities available on the remote machine :)