#684 new
Meindert

Japanese mojibake in title or title and body

Reported by Meindert | March 25th, 2014 @ 05:25 AM

With Japanese language e-mail, some of it arrives fine, some is mojibake in the title but with readable body text, some is mojibake in the sender and title but with readable body text, and some is mojibake in the title and body text.

http://en.wikipedia.org/wiki/Mojibake

The accounts in question are Google Apps mail accounts (Gmail with custom domains).

For an e-mail with mojibake title only I see a content type header:

Content-Type: text/plain;charset="iso-2022-jp"

For an e-mail with mojibake in both the title and body text I don't see a Content-Type header.

Sparrow is not having this problem, so I assume that the problem is client-side, or perhaps Sparrow is detecting and correcting character encoding problems in the e-mails that MailMate isn't. I remember a developer once explained to me that to be safe he needed to sample a certain number of bytes in the text and use them to guess at the character set. Here's the bible on this stuff: http://shop.oreilly.com/product/9780596514471.do ("CJKV Information Processing, 2nd Edition," Ken Lunde)

Comments and changes to this ticket

  • benny

    benny March 25th, 2014 @ 08:19 AM

    I recently added that MailMate looks for any specified charsets in the message and then uses that as default for any missing charset-definitions. This worked well for various badly formatted Russian emails. I've now made sure that this would also work for iso-2022-jp (and family).

    You can send example messages to me using “Help ▸ Send Feedback” (use “Message ▸ Forward as Attachment”) and I'll examine what the exact problem is.

    (MailMate doesn't guess based on samples (at least not yet).)

  • benny

    benny March 25th, 2014 @ 10:59 AM

    Hold down ⌥ when clicking “Check Now” in the Software Update preferences pane to try out the change mentioned in the previous update to this ticket.

  • Meindert

    Meindert March 27th, 2014 @ 06:42 AM

    Thanks, there seem to be fewer problems now (although I think I deleted many of the problem e-mails the other day, many of which were commercial).

    I saved a few examples of remaining problems and I'll try to send them on, but now I seem to be having SMTP problems when I try to use Help > Send Feedback.

  • benny

    benny March 27th, 2014 @ 10:59 AM

    • State changed from “new” to “resolved”

    Thanks for the examples. I've improved the “guessing” a bit. A new test release is available.

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

New-ticket Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป

Mac OS X email client.

Shared Ticket Bins

People watching this ticket

Pages