International email

From HandWiki

International email arises from the combined provision of internationalized domain names (IDN)[1] and email address internationalization (EAI).[2] The result is email that contains international characters (characters which do not exist in the ASCII character set), encoded as UTF-8, in the email header and in supporting mail transfer protocols. The most significant aspect of this is the allowance of email addresses (also known as email identities) in most of the world's writing systems, at both interface and transport levels.

Email addresses

Traditional email addresses are limited to characters from the English alphabet and a few other special characters.[3]

The following are valid traditional email addresses:

Abc@example.com                               (English, ASCII)
Abc.123@example.com                           (English, ASCII)   
user+mailbox/department=shipping@example.com  (English, ASCII)
!#$%&'*+-/=?^_`.{|}~@example.com              (English, ASCII)
"Abc@def"@example.com                         (English, ASCII)
"Fred\ Bloggs"@example.com                    (English, ASCII)
"Joe.\\Blow"@example.com                      (English, ASCII)

A Russian might wish to use иван.сергеев@пример.рф as their identifier but be forced to use a transcription such as ivan.sergeev@example.ru or even some other completely unrelated identifier instead. The same is true of Chinese, Japanese, and other nationalities that do not use Latin scripts, but also applies to users from non-English-speaking European countries whose desired addresses might contain diacritics (e.g. André or Płużyna). As a result, email users are forced to identify themselves using non-native scripts, which may result in errors due to ambiguity of transliteration (for example, иван.сергеев may become ivan.sergeev, ivan.sergeyev, or something else). Alternatively, developers of email systems must compensate for this by converting identifiers from their native scripts to ASCII scripts and back again at the user interface layer.

International email, by contrast, uses Unicode characters encoded as UTF-8—allowing for the encoding the text of addresses in most of the world's writing systems.[4]

The following are all valid international email addresses:

Template:Monospace               (Chinese, Unicode)
ಬೆಂಬಲ@ಡೇಟಾಮೇಲ್.ಭಾರತ    (Kannada, Unicode)
अजय@डाटा.भारत               (Hindi, Unicode)
квіточка@пошта.укр          (Ukrainian, Unicode)
χρήστης@παράδειγμα.ελ       (Greek, Unicode)
Dörte@Sörensen.example.com  (German, Unicode)
коля@пример.рф              (Russian, Unicode)

UTF-8 headers

Although the traditional format for email header section allows non-ASCII characters to be included in the value portion of some of the header fields using MIME-encoded words (e.g. in display names or in a Subject header field), MIME-encoding must not be used to encode other information in a header, such as an email address, or header fields like Message-ID or Received. Moreover, the MIME-encoding requires extra processing of the header to convert the data to and from its MIME-encoded word representation, and harms readability of a header section.

The 2012 standards RFC 6532 and RFC 6531 allow the inclusion of Unicode characters in a header content using UTF-8 encoding, and their transmission via SMTP—but in practice support is only slowly rolling out.[5]

Interoperability via downgrading

Domain internationalization works by downgrading. UTF-8 parts, known as U-Labels, are transformed into A-Labels via an ad-hoc method called IDNA. For example, sörensen.example.com is encoded as xn--srensen-90a.example.com. In 2003, when the need was addressed, that seemed easier than checking that all DNS software could comply with UTF-8 strings, although in theory DNS can transport binary data. This encoding is needed before issuing DNS queries.

Since traditional email standards constrain all email header values to ASCII only characters, it is possible that the presence of UTF-8 characters in email headers decreases the stability and reliability of transporting such email. This is because some email servers do not support these characters. Checking compliance with UTF-8 strings must be done software package by software package (see #Adoption below.) There was an experimental method proposed by the IETF, by which email could be somehow downgraded into the legacy all-ASCII format which all standard email servers support.[2][6] This proposal was deemed too cumbersome; the meaning of the left hand side part of an email address is local to the target server, and so there is no way to check whether xn--something is a valid user name, used in some domain. It was later obsoleted in 2012.[7]

Standards framework

The set of Internet RFC documents RFC 6530, RFC 6531, RFC 6532, and RFC 6533, all of them published in February 2012, define mechanisms and protocol extensions needed to fully support internationalized email addresses. These changes include an SMTP extension and extension of email header syntax to accommodate UTF-8 data. The document set also includes discussion of key assumptions and issues in deploying fully internationalized email.

Adoption

  • 2010-10-29: PRweb Afilias and .JO Registry Bring Native Language E-mail to Arabic Internet Users [8]
  • 2013-11-14: The Bat! Email Client implemented support for Internationalized Domain Names (IDN) in email addresses.[9]
  • 2014-07-15: Postfix mailer started supporting[10] Internationalized Email, also known as EAI or SMTPUTF8, defined in RFC 6530 .. RFC 6533. Initial support was made available with a development version 20140715, and on 2015-02-08 ended up in a stable release 3.0.0.[11] This supports UTF-8 in SMTP or LMTP sender addresses, recipient addresses, and message header values.
  • 2014-07-19: XgenPlus Email Server started supporting [12] IDN based[13] email, also known as support for SMTPUTF8, especially for .भारत domain.
  • 2014-08-05: Google announced[14] that Gmail will recognize addresses that contain accented or non-Latin characters, with more support for internationalization to follow. Their mailers (MX MTA) are announcing support for SMTP Extension for Internationalized Email (SMTPUTF8, RFC 6531).
  • 2014-09-30: Message Systems announced[15] that their product Momentum (versions 4.1 and 3.6.5) provides SMTPUTF8 support, the email address internationalization extension to the SMTP protocol, allowing emails to be sent to new, non-western addressed recipients.
  • 2014-10-22: the version 2.10.0 of Amavis mail content filter was released[16] which added support for SMTPUTF8, EAI, and IDN.
  • 2016-12-07: почта.рус Launches fully Russian (Cyrillic) email in Moscow through a press conference.[17][18]
  • Chief Minister Vasundhara Raje of Rajasthan launched one Free Email address @rajasthan.in and @राजस्थान.भारत domain on 3 December 2017. Rajasthan state became the World's first state to provide email address to every citizen in their own language.
  • 2016-10-18: Data Xgen Technologies launched a free linguistic email address under the name "DATAMAIL". In support of Digital India this made an Indian email app stop that supports IDN (internationalized domain name) in Hindi (हिन्दी), Gujarati (ગુજરાતી), Urdu (اردو), Punjabi (ਪੰਜਾਬੀ ਦੇ), Tamil (தமிழ்), Telgu (తెలుగు), Bengali (বাংলা), Marathi (मराठी), Latin English. DATAMAIL has launched international languages for the countries using Arabic (العَرَبِيَّة), Russian (русский)and Chinese (汉语/漢語) as their base language.[19][20]
  • 2017-03-07: Apple's App Store approves publication of an iOS app with EAI support.[21]
  • 2017-12-27: Microsoft announces coming IDN email support on Office 365[22] and also announces partner XgenPlus hosting IDN mailboxes.[23]
  • 2018-01-03: Microsoft Adds E-Mail Internationalization to Exchange Online.[24]
  • 2018-09-18: Courier-MTA releases support for Unicode E-mail messages, in UTF-8, for all Courier packages. In addition, Courier-IMAP uses Unicode (UTF8) for names of maildir folders.[25]
  • 2020-07-29: DataMail launched Kannada language[26] email address to break the language barrier

See also

References

  1. Started with: Paul Hoffman; Marc Blanchet (7 March 2003), Nameprep: A Stringprep Profile for Internationalized Domain Names (IDN), doi:10.17487/RFC3491, RFC 3491, https://tools.ietf.org/html/rfc3491 
  2. 2.0 2.1 Started with: John C Klensin; YangWoo Ko (7 February 2007), Overview and Framework for Internationalized Email, doi:10.17487/RFC4952, RFC 4952, https://tools.ietf.org/html/rfc4952 
  3. RFC 5322: Internet Message Format
  4. RFC 6530: Overview and Framework for Internationalized Email
  5. Mackie, Kurt (2 January 2018). "Exchange Online Getting E-Mail Internationalization Support". Redmond magazine. https://redmondmag.com/articles/2018/01/02/exchange-online-email-internationalization.aspx. Retrieved 1 November 2018. 
  6. Jiankang YAO; Wei MAO (8 July 2008), SMTP Extension for Internationalized Email Addresses, doi:10.17487/RFC5336, RFC 5336, https://tools.ietf.org/html/rfc5336 
  7. J. Klensin; Y. Ko (February 2012), Overview and Framework for Internationalized Email, doi:10.17487/RFC6530, RFC 6530, https://tools.ietf.org/html/rfc6530 
  8. "Afilias and .JO Registry Bring Native Language E-mail to Arabic Internet Users". 2010-10-29. https://www.prweb.com/releases/afilias/arabic_idn_e-mail/prweb4719214.htm. 
  9. "The Bat! 6.0 with Unicode and IDN support: The Bat! speaks many languages". 2013-11-14. https://www.ritlabs.com/en/about/press_releases.php?ELEMENT_ID=4889. 
  10. [1] Postfix SMTPUTF8 support (unicode email addresses)
  11. [2] Postfix stable release 3.0.0
  12. "Government to Offer Free .bharat Domain Name With .in Purchase". http://gadgets.ndtv.com/internet/news/government-to-offer-free-bharat-domain-name-with-in-purchase-868589. 
  13. "IDN Email supported by XgenPlus email server". https://www.xgenplus.com/whats-new/. 
  14. [3] A first step toward more global email
  15. [4] Message Systems Introduces Latest Version Of Momentum With New API-Driven Capabilities
  16. [5] Amavis 2.10.0 released
  17. ""Почта.рус" хочет избавиться от препятствий". http://www.comnews.ru/content/105068/2016-12-08/pochtarus-hochet-izbavitsya-ot-prepyatstviy. 
  18. "Cyrillic email launched in .РУС". https://cctld.ru/en/news/news_detail.php?ID=11042. 
  19. "Data Xgen Technologies launches email address in Indian languages". Deccan Chronicle. 2016-10-18. http://www.deccanchronicle.com/technology/in-other-news/181016/data-xgen-technologies-launches-email-address-in-local-indian-languages.html. 
  20. "DataMail: World's first free linguistic email service supports eight India languages - The Economic Times". The Economic Times. http://economictimes.indiatimes.com/tech/internet/datamail-worlds-first-free-linguistic-email-service-supports-eight-india-languages/articleshow/54923001.cms. 
  21. "EAI Mail". 7 March 2017. https://apps.apple.com/ae/app/eai-mail/id1185502308. 
  22. "EAI support announcement". The Microsoft Exchange Team Blog. https://blogs.technet.microsoft.com/exchange/2017/12/27/eai-support-announcement/. Retrieved 9 November 2018. 
  23. Hollander, Don (21 February 2018). "Microsoft announcement of EAI in India" (in en-US). https://uasg.tech/2018/02/microsoft-announcement-eai-india/. 
  24. Kurt Mackie (3 January 2018). "Microsoft Adds E-Mail Internationalization to Exchange Online". MCPmag. https://mcpmag.com/articles/2018/01/03/exchange-online-email-internationalization.aspx. 
  25. Sam Varshavchik (18 September 2018). "New releases of Courier packages". courier-announce (Mailing list). Retrieved 5 July 2019.
  26. "DataMail launched Kannada language email address to break the language barrier" (in en-US). 2020-07-29. http://businessnewsthisweek.com/business/datamail-launched-kannada-language-email-address-to-break-the-language-barrier/. 

Bibliography

External links