Sorry you're obviously correct about sieve. Maybe I misremember about server side search in mutt (not sure if there is a difference to neomutt), but I remember imap search was very slow if caching was not enabled (IIRC there's even a warning in the mutt documentation about this).