The expectation among the general population is that email is delivered in minutes. Any deviation from that timeline is a negative user experience. Failing fast and telling the sender is the best approach. Silently failing to deliver an email until 3 days later would cause more issues.