On some distros you can install rustup directly, e.g. NixOS or Arch. For Ubuntu, it's sadly not in the default repositories, but there is a snap for rustup uploaded by the rustup maintainer.

https://pkgs.org/search/?q=rustup

https://snapcraft.io/rustup