The Caddy web site provides a helpful download link where you can select your architecture and addons/features and receive a binary. You can easily point a script at it, like in this Ansible role[0], for instance.

0. https://github.com/antoiner77/caddy-ansible