Freron MailMate

Comments and changes to this ticket

• 

  benny September 22nd, 2016 @ 11:46 AM

  When an account has reached the [THROTTLED] state then MailMate now tries to give it a pause, but we need to figure out how it got into this state and the most likely reason is some kind of busy loop. Could you open the Activity Viewer (⌥⌘0) and let it run for a while before using “Help ▸ Send Server Logs”. Then I'll see if I can spot something suspicious.

• You flagged this item as spam.
  

  Rob Tull September 22nd, 2016 @ 08:15 PM

  Hey Benny! Is this enough info for you?

• 

  benny September 23rd, 2016 @ 11:25 AM

  Thanks. This clearly shows a busy loop triggered by MailMate somehow not realizing that an update of of the \Seen keyword works as expected:

  20:14:43 C: H7270 UID STORE 80931,80940,80972,80983 +FLAGS.SILENT (\Seen)  
  20:14:43 S: H7270 OK Success  
  20:14:43 C: H7271 UID FETCH 80931,80940,80972,80983 (FLAGS)  
  20:14:43 S: * 4818 FETCH (UID 80931 MODSEQ (6673419) FLAGS ($NotJunk \Seen))  
  20:14:43 S: * 4825 FETCH (UID 80940 MODSEQ (6669343) FLAGS ($NotJunk \Seen))  
  20:14:43 S: * 4855 FETCH (UID 80972 MODSEQ (6678477) FLAGS ($NotJunk \Seen))  
  20:14:43 S: * 4866 FETCH (UID 80983 MODSEQ (6678483) FLAGS ($NotJunk \Seen))  
  20:14:43 S: H7271 OK Success
  

  This might be tricky to debug (but important). I'll contact you by email for additional information.

• You flagged this item as spam.
  

  Vincent Danen September 28th, 2016 @ 04:25 PM

  I'm seeing the exact same behaviour here and it's frustrating as heck because I leave Mailmate alone for a few days on this computer, come back and see it "throttled" and no mail at all.

  I'm going to restart Mailmate and let it collect some activity and send it in.

• You flagged this item as spam.
  

  Vincent Danen October 1st, 2016 @ 03:25 PM

  So this is odd, but I upgraded this machine to macOS Sierra yesterday and now it seems to be working ok... unsure if it's due to the upgrade or Google fixing/changing something but seems to be working properly for the last ~24hrs anyways...

• 

  benny October 3rd, 2016 @ 01:59 PM

  The log files you sent me did not really show what the problem was other than it might be triggered by the quite large “All Messages” mailbox. It requires a lot of data for MailMate to synchronize this mailbox from scratch and maybe this happens too often. If you still have the issue then we can try to analyze this in more detail.

• 

  benny October 3rd, 2016 @ 02:00 PM

  • State changed from “new” to “cantreproduce”

• You flagged this item as spam.
  

  Vincent Danen October 3rd, 2016 @ 02:10 PM

  I actually spoke too soon. =(

  This morning I checked and I see the inbox being synched ok, but none of the other folders are (verified by looking on the web).

  I can send you more logs (I've kept the activity window open for the last few days) or whatever you want me to do to try to get you more info. Even when I click on a folder and it looks like it's doing something (activity icon spinning), it doesn't show me new stuff in that folder that I know is there.

• You flagged this item as spam.
  

  Rob Tull October 3rd, 2016 @ 05:25 PM

  Would it be helpful to attach some more logs on my end? Behavior is continuing and I'm happy to do whatever I can to help identify the issue. Personally, I would rather not use Google for email but it is mandated by my company so I don't have a lot of choice here and so getting MailMate to work well with it matters a lot to me.

• You flagged this item as spam.
  

  Vincent Danen October 3rd, 2016 @ 05:47 PM

  I'm in the same boat as Rob here... anything I can do to help with making this work as reliably as 1.9.4 did I will do. Thanks!

• 

  benny October 3rd, 2016 @ 07:59 PM

  You are both welcome to send me a new set of logs -- using “Help ▸ Send Server Logs”. From what I've seen until now I'm not sure it's the same issue. At least only the logs from Rob showed a busy loop with the server. (But maybe this only happens temporarily and cannot always be seen in the logs...)

  Rob: I sent you an email asking for additional information as noted in this ticket. I assume you never got that. Instead, I'll reply when you send me some logs with the Help menu item.

• You flagged this item as spam.
  

  Rob Tull October 3rd, 2016 @ 09:21 PM

  Just sent a new set of logs. They're coming from my work address (rob AT classyllama) but have the same name in the footer.

  I did not receive your email with the request for additional information or accidentally deleted it or something. Anyway, if you'll re-send I'll watch for it and respond.

• 

  benny October 3rd, 2016 @ 09:45 PM

  Vincent: Based on the logs from Rob I think it's likely that your issue is the same. That would be a good thing.

• You flagged this item as spam.
  

  Rob Tull October 19th, 2016 @ 05:22 PM

  I've resolved this issue.

  I noticed that for some reason many messages were showing up twice in the All Mail folder in MailMate, almost as though some kind of duplication checker hadn't worked. I think this came up as a part of the upgrade somehow so I just deleted my IMAP account entirely and then re-added it. This synced in my entire Gmail account completely from scratch, which worked fine.

  As of now, no duplicates are showing and the constant sync issues have now also stopped.

• 

  benny October 20th, 2016 @ 04:42 PM

  I have another user who can still reproduce this issue. Hopefully
  that'll lead to a fix since I'm afraid the issue is also going to return
  for you. (I'm still not able to reproduce the issue myself.)

• You flagged this item as spam.
  

  Rob Tull October 21st, 2016 @ 02:25 PM

  Unfortunately, you're correct benny. The issue has returned. Related to that, I'm starting to see duplicate IDs in the All Mail box. I'm wondering if the underlying issue might be related to the de-duping for All Mail not quite working correctly? Speculating…

  I'm going to try disabling the All Mail box and see if that resolves the issue.

  Screenshot: http://files.classyllama.com/c689cb8e/all-mail_duplication.png

• You flagged this item as spam.
  

  Rob Tull October 24th, 2016 @ 06:34 PM

  I've disabled All Mail for a few days and have had no problems. It appears the issue is somehow related to the special processing MailMate is doing when processing a GMail All Mail box.

  Sorry benny. I know how much you dislike Google's IMAP implementation…

• 

  benny October 25th, 2016 @ 12:41 PM

  @Rob: Ok, I'm pretty sure this is only an issue with the “All Mail” mailbox. And even though it's a workaround for a Gmail issue then I'm also pretty sure the problem is a MailMate bug. I'll continue to investigate.

• You flagged this item as spam.
  

  Paula Coelho November 7th, 2016 @ 06:02 PM

  Just to mention that I started having the same issue today, in one of my Gmail accounts. I'm following the ticket now. If there is anything in particular that I should do, please let me know.

• 

  benny January 24th, 2017 @ 03:37 PM

  I've had some progress on this annoying issue. It is caused by the appearance of duplicates in the “All Mail” mailbox in the sense that MailMate has two versions of a single message which both have the same UID (which means that only 1 copy actually exists on the server). When MailMate tries to do an IMAP keyword change then it seems to succeed, but the result is then compared with the wrong “version” of the local message resulting in MailMate trying to make the change again and again and again...

  I've changed MailMate such that it detects these duplicates when trying to change IMAP keywords. It then deletes one of the copies locally. The main problem now is that I don't know how it gets into this state. If you want to help out then fetch the latest test release (r5329): Hold down ⌥ when clicking “Check Now” in the Software Update preferences pane.

  In order to enable the workaround you need to enable this preferences:

  defaults write com.freron.MailMate MmDebugFlags -bool YES
  

  This should stop the looping behavior.

  This test version also crashes when it detects the introduction of these duplicates. I'm hoping that'll get me closer to why it happens. I still cannot reproduce the issue myself :(

  Thanks in advance.

• You flagged this item as spam.
  

  Vincent Danen March 4th, 2017 @ 06:24 PM

  Hi Benny. Sorry I've not been responsive on this.. life got in the way of me spending time on this. I've got r5347 installed and enabled the MMDebugFlags and have re-enabled exposing All Mail to IMAP. When/if I see anything with respect to this I'll report it; just wanted to let you know that I'm (finally) looking at this again. Thanks!

• 

  benny March 6th, 2017 @ 02:49 PM

  • State changed from “cantreproduce” to “fixreleased”

  @Vincent: I think this issue is resolved, but certainly let me know if this is not the case. I'll switch to fixreleased hoping that it's actually fixed :) You can start without MmDebugFlags until you might see the issue again.

• You flagged this item as spam.
  

  Vincent Danen March 10th, 2017 @ 02:28 PM

  Gotchya. So basically the same defaults command with "-bool NO", correct? Not "defaults delete"? Thanks Benny. Hopefully it never shows up again =)

• 

  benny March 11th, 2017 @ 07:13 AM

  @Vincent: Both delete and NO works, but the first one is perhaps a bit “cleaner”.

• You flagged this item as spam.
  

  Gene June 19th, 2017 @ 01:29 AM

  Hi Benny — I've been having the same problem on and off for a while. I use mailmate on two computers. Each one limits the mailmate connections to 3 for the affected gmail accounts. I have the email accounts configured on two ios devices, but because of the throttling issue I have set both ios devices to fetch mail only manually (so no more push or intermittent fetch for me for several weeks.)

  I'm also sending over my logs.

  —Gene

• 

  benny June 19th, 2017 @ 08:46 AM

  @Gene: It's not obvious what's wrong based on the logs. I'll comment on the details by email and hopefully we can figure it out.