I was thinking of using the desktop email clients doing the backup.

but someone who cannot do that is definitely not going to move off of free Gmail/Yahoo mail/...