Replying to email is one thing - a pita to implement securely.

But reading? On-premise? You already allow basic algorithms to read your mail, for spam control and whenever you search through your messages. Having a better algorithm (as long as it's still on device) has no difference in terms of safety.