I don't remember if OfflineIMAP was the tool I tried or not, but at the time it was quite challenging. I always suspected that rate limiting on the mail server was blowing up the download tool, but I couldn't figure it out. This was a fair number of years ago though, so things are hopefully better now.