ISO-IR-165

From HandWiki
CCITT Chinese set (ISO-IR 165)
MIME / IANAiso-ir-165
Alias(es)CN-GB-ISOIR165 (EUC form)[1]
Language(s)Simplified Chinese, English, Russian
Partial support:
Greek, Japanese
StandardITU T.101, annex C
DefinitionsISO-IR 165
ExtendsGB 2312
Encoding formatsISO-2022-CN-EXT, Videotex Data Syntax 2
Succeeded byGB 18030

The CCITT Chinese Primary Set[2] is a multi-byte graphic character set for Chinese communications created for the Consultative Committee on International Telephone and Telegraph (CCITT) in 1992.[3] It is defined in ITU T.101, annex C, which codifies Data Syntax 2 Videotex.[2] It is registered with the ISO-IR registry for use with ISO/IEC 2022 as ISO-IR-165,[4] and encodable in the ISO-2022-CN-EXT code version.[1]

It is an extended modification of GB/T 2312-80, and corresponds to the union of the Mainland Chinese GB standards GB 6345.1-86 and GB 8565.2-88, with some further modification and extensions. A subset of the GB 6345.1 extensions are incorporated into GB 18030, while GB 8565.2 serves as the Mainland Chinese source reference for certain CJK Unified Ideographs.

GB 6345.1

GB 6345.1-86 (32 × 32 Dot Matrix Font Set of Chinese Ideographs for Information Interchange) includes both a corrigendum and an extension for GB 2312.[3] The corrigendum alters the following two characters:

Alterations made to existing GB 2312 characters by GB 6345.1
Row-cell EUC GB 2312 (Unamended)[5] GB 6345.1 Notes
03-71 0xA3E7 g ɡ [lower-alpha 1]
79-81 0xEFF1 [lower-alpha 2]
  1. Corresponds to U+FF47 in Unicode; however, the amended reference glyph can also correspond to U+0261 ɡ . See below for how U+0261 is typically mapped to/from GB/T 6341.1, versus how it is mapped to/from ISO-IR-165. GB 18030 swaps this one back to the original[5] looped glyph.[6]
  2. The unamended reference glyph is a Traditional Chinese character corresponding to U+937E. The character in question is usually replaced with 钟 (U+949F, also the simplification of 鐘) in Simplified Chinese except in names of persons; the amended glyph is an alternate simplified form corresponding to U+953A.

Deployed implementations incorporating GB 2312, such as Windows code page 936, generally follow these corrections in mapping 79-81 to U+953A.[7]

The extension adds half-width ISO 646-CN characters in row 10 (in addition to the existing full-width characters in row 3) and extends the set of 26 non-ASCII pinyin characters in row 8 with six additional such characters. These GB 6345.1 extensions are also incorporated into GB/T 12345, the Traditional Chinese counterpart to GB 2312, in addition to 29 vertical presentation forms in row 6.[3][8]

Later GB/T 6345.1-2010 published in 2011 officially adds half-width forms of the 32 pinyin characters (including the six new additions) in row 8 to row 11.[9] This addition is not featured in GB 18030.[6]

The six additional pinyin characters from GB 6345.1 and the vertical presentation forms from GB 12345 — but not the half-width forms — are included in the classic Mac OS encoding for Simplified Chinese (a modification of EUC-CN),[10] and also as two-byte codes in GB 18030.[6] The additional pinyin characters are as follows:[10]

Extensions made by GB 6345.1 to GB 2312 row 8
Row-cell EUC Character[10][6] Notes
08-27 0xA8BB U+0251 ɑ
08-28
08-29 0xA8BD U+0144 ń
08-30 0xA8BE U+0148 ň
08-31 0xA8BF U+01F9 ǹ [lower-alpha 1]
08-32 0xA8C0 U+0261 [lower-alpha 2]
  1. This composed character was added in Unicode 3.0. Prior to this, this character was mapped to its composition sequence (i.e. U+006E U+0300) by Apple.[10] This change predates the stabilisation of Unicode normalisation forms, which was introduced in Unicode 3.1.[11] It is mapped to U+E7C8 by Windows code page 936.[12]
  2. Matches the unamended reference glyph for 03-71 (see above) in being a looped g, in spite of being typically mapped to U+0261. Mappings used for ISO-IR-165 differ (see below). GB 18030 swaps 03-71 back to the looped g, and makes this one the open g.[6]

These extensions and modifications to GB 2312 were first introduced in GB 5007.1-85 in 1985.

GB 8565.2

GB 8565.2-88 (Information Processing - Coded Character Sets for Text Communication - Part 2: Graphic Characters) defines an extension for GB 2312, adding 705 characters between rows 13–15 and 90–94, of which 69 (all in row 15) are non-hanzi. It includes the GB 2312 corrections from GB 6345.1, but not its extensions.[3]

The Unihan database references GB 8565.2 as the Mainland Chinese source of several hanzi included in Unicode. Its Unihan source abbreviation is G8.[2]

CCITT changes

ISO-IR-165 incorporates the GB 2312 extensions from both GB 6345.1-86 and GB 8565.2-88.[3] Additionally, it adds 161 further characters (including 139 hanzi, identified as “general Chinese characters and variants”).[3][4] These CCITT hanzi extensions have on occasion been mistaken for standard GB 8565.2 characters, including in previous revisions of the Unihan database.[2] In total the set contains 8446 characters.

A number of patterned semigraphic characters are included in row 6.[4] This collides with the vertical presentation forms included in other extensions such as Mac OS Simplified Chinese[10] and GB 18030.[6]

The GB 6345.1 corrections to GB 2312 are applied, but two Unicode mappings are reversed compared to other encodings which include GB 2312 with GB 6345.1 extensions. The table below shows the mappings and their corresponding glyphs including GB 18030:

Row-cell EUC GB 2312 (unamended)[5] GB 6345.1[9] GB 6345.1 mapping[10] ISO-IR-165[4] ISO-IR-165 mapping[13] GB 18030[6] GB 18030 mapping[6]
03-71 0xA3E7 g ɡ U+FF47 ɡ U+0261 g U+FF47
08-32 0xA8C0 (absent) g U+0261 g U+FF47 ɡ U+0261
79-81 0xEFF1 U+953A U+953A U+953A

References

  1. 1.0 1.1 Zhu, HF.; Hu, DY.; Wang, ZG.; Kao, TC.; Chang, WCH.; Crispin, M. (1996), "Chinese Character Encoding for Internet Messages", Requests for Comments (IETF), doi:10.17487/rfc1922, RFC 1922, https://tools.ietf.org/html/rfc1922 
  2. 2.0 2.1 2.2 2.3 Chung, Jaemin (2018-01-24). "Pseudo-G8 characters". https://appsrv.cse.cuhk.edu.hk/~irg/irg/irg50/IRGN2276.pdf. 
  3. 3.0 3.1 3.2 3.3 3.4 3.5 Lunde, Ken (2009). CJKV Information Processing: Chinese, Japanese, Korean & Vietnamese Computing (2nd ed.). Sebastopol, CA: O'Reilly. pp. 94–111. ISBN 978-0-596-51447-1. 
  4. 4.0 4.1 4.2 4.3 CCITT (1992-07-13), Codes of the Chinese graphic character set for communication, ITSCJ/IPSJ, ISO-IR-165, https://www.itscj.ipsj.or.jp/iso-ir/165.pdf 
  5. 5.0 5.1 5.2 China Association for Standardization, Coded Chinese Graphic Character Set for Information Interchange, ITSCJ/IPSJ, ISO-IR-58, https://www.itscj.ipsj.or.jp/iso-ir/058.pdf 
  6. 6.0 6.1 6.2 6.3 6.4 6.5 6.6 6.7 Standardization Administration of China (SAC) (2005-11-18). GB 18030-2005: Information Technology—Chinese coded character set. https://archive.org/details/GB18030-2005. 
  7. Steele, Shawn (2000). "cp936 to Unicode table". Microsoft, Unicode Consortium. https://www.unicode.org/Public/MAPPINGS/VENDORS/MICSFT/WINDOWS/CP936.TXT. 
  8. Lunde, Ken (1998). Appendix F: GB/T 12345. O'Reilly Media. ISBN 9781565922242. https://resources.oreilly.com/examples/9781565922242/blob/master/AppF/gbt12345.pdf. 
  9. 9.0 9.1 Standardization Administration of China (SAC) (2011-01-10) (in zh-CN). GB/T 6345.1-2010 信息技术 汉字编码字符集(基本集) 32点阵字型 第1部分宋体. China. http://archive.org/details/gb-6345.1-2010. 
  10. 10.0 10.1 10.2 10.3 10.4 10.5 "Map (external version) from Mac OS Chinese Simplified encoding to Unicode 3.0 and later.". Apple, Inc. https://unicode.org/Public/MAPPINGS/VENDORS/APPLE/CHINSIMP.TXT. 
  11. "Unicode Character Encoding Stability Policies". Unicode Consortium. 2017-06-23. https://www.unicode.org/policies/stability_policy.html. 
  12. Cite error: Invalid <ref> tag; no text was provided for refs named ms936-with-pua
  13. Viswanadha, Raghuram (2000-08-30). "Unicode to ISO-IR-165 table". International Components for Unicode. IBM. https://opensource.apple.com/source/ICU/ICU-3.13/icuSources/data/mappings/iso-ir-165.ucm.  (Note: codes are listed in the source in 7-bit form: add 0x80 to each byte for EUC form, or subtract 0x20 for kuten form)

External links