Japanese mojibake in title or title and body
Reported by Meindert | March 25th, 2014 @ 05:25 AM
With Japanese language e-mail, some of it arrives fine, some is mojibake in the title but with readable body text, some is mojibake in the sender and title but with readable body text, and some is mojibake in the title and body text.
http://en.wikipedia.org/wiki/Mojibake
The accounts in question are Google Apps mail accounts (Gmail with custom domains).
For an e-mail with mojibake title only I see a content type header:
Content-Type: text/plain;charset="iso-2022-jp"
For an e-mail with mojibake in both the title and body text I don't see a Content-Type header.
Sparrow is not having this problem, so I assume that the problem is client-side, or perhaps Sparrow is detecting and correcting character encoding problems in the e-mails that MailMate isn't. I remember a developer once explained to me that to be safe he needed to sample a certain number of bytes in the text and use them to guess at the character set. Here's the bible on this stuff: http://shop.oreilly.com/product/9780596514471.do ("CJKV Information Processing, 2nd Edition," Ken Lunde)
Comments and changes to this ticket
-
benny March 25th, 2014 @ 08:19 AM
I recently added that MailMate looks for any specified charsets in the message and then uses that as default for any missing charset-definitions. This worked well for various badly formatted Russian emails. I've now made sure that this would also work for
iso-2022-jp(and family).You can send example messages to me using “Help ▸ Send Feedback” (use “Message ▸ Forward as Attachment”) and I'll examine what the exact problem is.
(MailMate doesn't guess based on samples (at least not yet).)
-
benny March 25th, 2014 @ 10:59 AM
Hold down ⌥ when clicking “Check Now” in the Software Update preferences pane to try out the change mentioned in the previous update to this ticket.
-
Meindert March 27th, 2014 @ 06:42 AM
Thanks, there seem to be fewer problems now (although I think I deleted many of the problem e-mails the other day, many of which were commercial).
I saved a few examples of remaining problems and I'll try to send them on, but now I seem to be having SMTP problems when I try to use Help > Send Feedback.
-
benny March 27th, 2014 @ 10:59 AM
- State changed from “new” to “resolved”
Thanks for the examples. I've improved the “guessing” a bit. A new test release is available.
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Mac OS X email client.
benny