#800 new
Dan Deighton

Mailmate crashes when searching "Unquoted Body Text" or

Reported by Dan Deighton | June 4th, 2014 @ 02:04 AM

Mailmate crashes every time that I try to run a search within "Unquoted Body Text" or "Common Headers or Body". Other fields, including "Quoted Body Text", work fine. I experienced this problem with the latest 1.7 as well as 1.8 (4214). I would really like to have this functionality.

Thanks,

-Dan

Comments and changes to this ticket

  • benny

    benny June 4th, 2014 @ 01:23 PM

    Have you allowed MailMate to send crash reports (General preferences pane)?

    Is it really crashing or is it hanging until you have to force quit?

  • benny

    benny June 9th, 2014 @ 12:28 PM

    I did. The crash happens when loading a database index (probably for the unquoted text). Three things to do:

    1. Update MailMate to the latest test version by holding down ⌥ when clicking “Check Now” in the Software Update preferences pane.
    2. Run this command and provide the output:

      ls -al ~/Library/Application\ Support/MailMate/Database.noindex/Headers/#unquoted*
      
    3. Run MailMate from the Terminal to see any error messages before the crash:

      /Applications/MailMate.app/Contents/MacOS/MailMate
      
  • benny

    benny June 9th, 2014 @ 09:47 PM

    Ok, the problem is that MailMate runs out of address space. Those database files are huge. They are roughly 20 times bigger than mine. That would correspond to around 1 million messages if I scale up my numbers. MailMate cannot handle that which means your emails might be very large on average? If you have 100K messages then they contain 11KB of unquoted text on average...

    How many messages do you have (estimated)?

    Have you deleted a large number of messages (or removed accounts)?

  • benny

    benny June 9th, 2014 @ 10:40 PM

    You are close to the limit I think. (I know some other users have ~500K messages, but it wouldn't work on my hardware.)

    Rebuilding the indexes is only going to help if it's a bug that made them so big. Is there any reason that you might have a very large average message size (unquoted text, not attachments)?

    For the sake of comparison, I would also like to see the following:

    ls -al ~/Library/Application\ Support/MailMate/Database.noindex/Headers/#quoted*
    

    I'll think about possible workarounds, but first I would like to figure out if there is a bug in play as well.

  • benny

    benny June 10th, 2014 @ 01:33 PM

    First try a manual rebuild if possible: http://manual.mailmate-app.com/rebuild

    I'm still puzzled by the file sizes. If a rebuild is possible then it would be nice to see the result of the ls commands afterwards.

    For how long have you used MailMate?

    Do you ever delete messages permanently (empty the trash)? If yes, How many messages would you say are deleted per day (rough estimate)?

  • benny

    benny June 11th, 2014 @ 03:35 PM

    It's positive that MailMate was able to complete the rebuild, but that doesn't help when the files are still too large. How long did the rebuild take?

    I have an experimental 64 bit version of MailMate which would probably not run into this problem. Unfortunately, it is even more memory hungry which means I don't think that is a viable solution before that is improved. But you probably cannot wait for that.

    MailMate has some (large) upper limits on how much plain text is indexed from any given message. I could make these configurable in order for you to limit the size of these files (requiring another rebuild though). Would that be a viable solution for you?

    Actually, you could also quit MailMate and then delete the files without the #lc suffix. This would prevent you from doing case sensitive search, but that might be acceptable.

  • benny

    benny June 12th, 2014 @ 10:03 AM

    There is a whole set of hidden preferences now to control this (untested though). The most interesting are probably these:

    defaults write com.freron.MailMate MmMaximumTotalSizeIndexed -integer 40000
    defaults write com.freron.MailMate MmMaximumQuoteLevelIndexed -integer 256
    

    Those are also the default values. The first one means that at most 40000 bytes are indexed from a text body part (unquoted+quoted). The second one controls the number of quote levels indexed which is practically all quoted levels by default.

    If your indexes are large because you receive a lot of long quote-all emails with large quote levels then it might be sufficient to change the second setting, e.g.,

    defaults write com.freron.MailMate MmMaximumQuoteLevelIndexed -integer 3
    

    There is unfortunately no way to only re-index these parts of the database (it would be nice though for this kind of debugging).

    You need to fetch this update as a direct download: http://updates.mailmate-app.com/archives/MailMate_r4321.tbz

  • benny

    benny June 12th, 2014 @ 10:11 AM

    Oh, I forgot that we already saw that the unquoted files are the problem. In other words you should change the other setting, e.g.,

    defaults write com.freron.MailMate MmMaximumTotalSizeIndexed -integer 10000
    

    Alternatively, these are also available:

    defaults write com.freron.MailMate MmMaximumTextLinesIndexed -integer 1000
    defaults write com.freron.MailMate MmMaximumTextParagraphSizeIndexed -integer 4096
    

    First one tells MailMate the maximum of lines (paragraphs) to be indexed from a body part. The second one puts a limit on the size of such a line (paragraph).

  • benny

    benny June 17th, 2014 @ 04:00 PM

    Sounds like r4321 might be more unstable or memory-hungry than previous revisions. Have you enabled sending crash reports in the General preferences pane of MailMate? I'm mostly interested in the crash when taking accounts online. Did this happen repeatedly? (Is this why you chose rebuilding again?)

    I've fixed a somewhat unrelated bug which should reduce the memory usage when importing. That might help with respect to the crash during rebuilding (crashes during rebuilding are not a problem with respect to database corruption - MailMate should be able to recover and continue rebuilding although the message count does not reflect that it doesn't start over).

    Thanks for taking the time to do this.

  • benny

    benny June 20th, 2014 @ 06:34 PM

    Sorry about the late response. Could you update to the latest test release (hold down ⌥ when clicking Check Now in the Software Update preferences pane). You can let it crash once or twice such that I'll get some “fresh” crash reports. Some intermediate revisions of MailMate have been very buggy, but I don't think that was the case for r4321 which means I don't expect the latest test version to behave much better for you.

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

New-ticket Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป

Mac OS X email client.

Shared Ticket Bins

People watching this ticket

Pages