I never liked the GUI or desktop behavior. I just install containerd, point dockerd at it, and download everything manually. This is pretty much my install, sans systemd units:

    curl -LO https://download.docker.com/linux/static/stable/x86_64/docker-20.10.8.tgz
    tar -xvzf docker-20.10.8.tgz
    mv docker/dockerd /usr/bin/dockerd
    mv docker/docker-init /usr/bin/docker-init
    mv docker/docker-proxy /usr/bin/docker-proxy
    mv docker/docker /usr/bin/docker
    rm -rf docker 
    rm docker-20.10.8.tgz