Generally it’s better to fetch email as not to trip additional spam filters. Many email providers support this, ex https://www.fastmail.com/help/receive/fetchotheremail.html. If moving from gmail you may need to adjust security settings, which is probably another indication that Google isn’t a great teammate in this.