I gave up on notmuch for the same reason, it won't just fetch mail over imap. I use gnus now.