MTAs will retry delivery for up to a week. There are other options for more advanced usage though, e.g. one can configure multiple mail servers with different priorities, `the helm` having the highest priority and if it's down a MTA would try the next mail server which could be just a forwarder like mailgun.