are you using mutt's built-in imap functionality, or something like offlineimap?