Code page 949 (IBM)

From HandWiki
IBM code page 949
IBM Korea KS PC-Data encoding (IBM-949).svg
Layout of the IBM-949 code page
Alias(es)
  • IBM-949, x-IBM949
  • ASCII-based: IBM-949C, x-IBM949C, cp949c
  • Ambiguous with UHC: 949, cp949
Language(s)Korean
Created byIBM
ClassificationExtended ISO 646, variable-width encoding, CJK encoding
ExtendsEUC-KR
Preceded byCode page 944

IBM code page 949 (IBM-949) is a character encoding which has been used by IBM to represent Korean language text on computers. It is a variable-width encoding which represents the characters from the Wansung code defined by the South Korea n standard KS X 1001 in a format compatible with EUC-KR, but adds IBM extensions for additional hanja, additional precomposed Hangul syllables, and user-defined characters.

Giving values in hexadecimal, bytes 0x00 through 0x7F are used for single byte KS X 1003 (ISO 646:KR) characters, a similar set to ASCII but with a won sign rather than a backslash. Bytes 0x80 through 0x84 are used for IBM single byte extension characters. Lead bytes 0x8F through 0xA0 are used for IBM double byte extension characters. Lead bytes 0xA1 through 0xFE are used for Wansung code (KS X 1001 characters in EUC-KR form, double byte), but with some unused space opened up for user-defined use.

Although both are sometimes named "cp949", IBM-949 is different from Windows code page 949 (IBM-1363), which is Microsoft's Unified Hangul Code, a different extension of EUC-KR. It should also not be confused with IBM's implementation of plain EUC-KR (IBM-970). Code page 949 in OS/2 is the IBM code page; however, a third-party patch exists to change this.[1]

Terminology and encoding labelling

Both IBM-949 and Unified Hangul Code (Windows-949) are known as "code page 949" (or "cp949") although they share only the EUC-KR subset in common. Neither has a standardised IANA-registered label to identify it. Although UHC is included in the WHATWG Encoding Standard,[2] with labels including "windows-949",[3] IBM-949 is not. IBM-949 therefore is not permitted in HTML5.

Although the meaning of the label "ibm-949" (and conversely "windows-949" and "ms949") is unambiguous where these labels are supported, the interpretation of the encoding labels "949" and "cp949" consequently varies between implementations. For example, International Components for Unicode uses "cp949", "949", "ibm-949" and "x-IBM949" to refer to IBM-949,[4] and additionally the labels "cp949c", "ibm-949c" and "x-IBM949C" to refer to an variant which uses unmodified ASCII mappings for 0x20–7E (resulting in duplicate mappings for the backslash),[5] while (of the labels incorporating the code page number 949) only "ms949" and "windows-949" are assigned to UHC.[6] This is in contrast to Python, which recognises both "cp949" and "949" (in addition to the more explicit "ms949" and "uhc", but not "windows-949") as labels for UHC, and does not include an IBM-949 codec.[7] The code page 949 used by Korean language versions of OS/2 is the IBM code page; to add support for the entire Unicode set of Korean syllables, a third-party patch exists to replace it with the Microsoft code page.[1]

IBM-949 is a variable width encoding defined as the combination of two fixed-width code pages, the single-byte Code page 1088 and the double-byte Code page 951.[8][9][10]

History

A version of Code page 951 (a DBCS-PC, i.e. double-byte non-EUC non-EBCDIC, code), the double-byte component for IBM-949, is defined in the September 1992 revision of IBM Corporate Specification C-H 3-3220-125, along with Code page 834 (a DBCS-Host, i.e. double-byte EBCDIC, code), which is the double byte component of Code page 933.[11] This version of Code page 949/951 considered the entire lead byte range 0x8F–A0 to be a user-defined region, and included only standard Wansung assignments and user-defined areas, thus not including some characters which Code page 933/834 included.[11] Some later versions, such as that implemented by International Components for Unicode (ICU), shrink the user-defined region to include these characters as extensions.[12]

IBM code pages 934 and 944
Language(s)Korean
ExtendsN-byte Hangul Code
Transforms / EncodesCode page 933
Succeeded byIBM code page 949

The earlier October 1989 revision of C-H 3-3220-125 had instead defined Code page 926 as its DBCS-PC code, which encoded the same characters as IBM-834 in a layout differing from both IBM-951 and IBM-834, which had a different lead byte range and was not an EUC-KR extension.[11] IBM-926 was combined with Code page 891 or Code page 1040 (respectively 8-bit N-byte Hangul Code and an extension thereof; compare how Shift JIS extends 8-bit JIS X 0201) to form IBM-934 or IBM-944 respectively.[13][14]

Code page 944/926 are now deprecated in favour of IBM-949. The 1992 revision designates code page 926 as "restricted" ("limited to the particular environment for which [it is] registered") and does not give its chart or mappings from the other code pages,[11] and CCSID 944 is categorised as "coexistence and migration"[14] (contrast "interoperable" for CCSID 949).[8] International Components for Unicode includes Unicode mappings for IBM-949[4][12] and IBM-933, but its IBM-944 mapping was removed in 2001.[15]

Single byte codes

IBM code page 949 (single byte component: 1088)[16][17][4][5][12]
0 1 2 3 4 5 6 7 8 9 A B C D E F
NUL ┌ ┐ └ ┘ │ ─ • ◘ ○ ◙ ♂ ♀ ♪ ♫ ☼
┼ ◄ ↕ ‼ ┴ ┬ ┤ ↑ ├ → ← ∟ ↔ ▲ ▼
 SP  ! " # $ % & ' ( ) * + , - . /
0 1 2 3 4 5 6 7 8 9 : ; < = > ?
@ A B C D E F G H I J K L M N O
P Q R S T U V W X Y Z [ ₩ ] ^
` a b c d e f g h i j k l m n o
p q r s t u v w x y z { | } ~ ⌂
¢ ¬ \ ‾ ¦ 8F
90 91 92 93 94 95 96 97 98 99 9A 9B 9C 9D 9E 9F
A0 1- 2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13-_ 14-_ 15-_
16- 17- 18- 19- 20- 21- 22- 23- 24- 25- 26- 27- 28- 29- 30- 31-
32- 33- 34- 35- 36- 37- 38- 39- 40- 41- 42- 43- 44- 45- 46- 47-
48- 49- 50- 51- 52- 53- 54- 55- 56- 57- 58- 59- 60- 61- 62- 63-
64- 65- 66- 67- 68- 69- 70- 71- 72- 73- 74- 75- 76- 77- 78- 79-
80- 81- 82- 83- 84- 85- 86- 87- 88- 89- 90- 91- 92- 93- 94-
  Differences from code page 437 (for 0x00–7F) or EUC-KR (for 0x80–FF)

Double byte codes

Lead bytes 0x8F–99, 0xC9, 0xFE (user defined ranges)

IBM-949 is designed to support a maximum of 1880 UDC (user-defined characters),[8] including ranges within unused rows of the Wansung plane, and ranges outside the Wansung plane. In this version, the lead bytes 0x8F–A0 contain a maximum of 1692 UDC, and lead bytes 0xC9 and 0xFE contain a maximum of 94 each (i.e. with trail bytes 0xA0–FE).[11] However, when the extensions to support the entire double-byte repertoire of IBM-933 are implemented, they use lead bytes 0x9A–A0, resulting in a smaller maximum number of characters left for user definition.[4][12]

When mapped to Unicode, 0xC9A1–C9FE (between the syllable and hanja ranges) are mapped to the Unicode Private Use Area code points U+E000–E05D, while 0xFEA1–FEFE (between the end of the hanja range and the end of the plane) are mapped to U+E05E–E0BB. Outside the Wansung plane, 0x8FA0–9AA5 (where the second byte is in the range 0xA1–FE) are mapped to the Private Use Area code points U+E0BC–E4CA.[4] The last of these ranges cuts into the start of the 0x9A row (shown below).

Collectively these private use ranges cover the code points U+E000..E4CA, allowing 1227 UDC to be mapped from IBM-949 to Unicode.[12] The separate private use area range U+F843..F86E is used by IBM to map some characters within the extended hanja range.[12] This follows early recommendations from the Unicode Consortium that corporate characters be allocated from U+F8FF downward and user-defined characters be allocated from U+E000 upward,[18] and is part of a larger corporate private use area scheme which is defined internally by IBM, and uses the range U+F83D..F8FF.[19][20]

Lead bytes 0x9A–9D (extended symbols and hanja)

According to the 1992 specification, this entire range is user-defined.[11] As implemented in the codec contributed to ICU by IBM, however, 0x9AA1 through 0x9AA5 are the end of the user-defined range. The remainder of this range includes some non-Hangul characters included in Code page 933 but not in Wansung code. 0x9AA6 through 0x9AAB contain miscellaneous technical or mathematical symbols. The remainder contains hanja additional to those included in KS X 1001, although some are mapped by IBM to the Private Use Area.[12]

IBM code page 949 (prefixed with 0x9A)[12][22]
0 1 2 3 4 5 6 7 8 9 A B C D E F
ǂ[lower-alpha 1] ≦ ≧ ￤ ʺ 喀 擱 羯 酣
醵 骼 蒹 哽 扃 檠 熲 畊 稧 雞 杲 瞽 詁 栱 槓 箜
蝌 霍 盥 鸛 鉸 佝 傴 媾 嫗 晷 甌 覯 颶 掬 跪 巹
漌 岌 笈 覇 鰭 唜 糯 喃 曩 迺 佞 獰 孥 鬧 靼 怛
闥 韃 党 蟷 碓 菟 咄 垌 肚 蚪 滕 灯 鐙 犖 幱 埓
榔 涼 魎 癘 膂 蠡 鑢 櫟 鬣 昤 泠 苓 蛉 潦 艫
IBM code page 949 (prefixed with 0x9B)[12][22]
0 1 2 3 4 5 6 7 8 9 A B C D E F
轤 漉 祿 轆 籟 蕾 誄 寥 僂 髏 窿 凛 廩 提 漓
离 螭 魑 痳 岦 媽 蟇 謾 鏝 鬘 魍 眛 苺 脉 俛 耄
鉾 濛 矇 瀰 糜 閩 婆 欂 牔 胖 髣 魴 潘 翻 辟 汴
辮 遍 駢 彆 迸 鴇 黼 蝠 丰 葑 仆 罘 苻 蜉 頫 鮒
吟 蕡 巿 髴 黻 妣 沙 沘 睥 篦 腓 轡 髀 擯 蘋 贇
顰 鬢 姒 麝 楂 槎 笥 槊 鑠 歃 鍤 霎 殤 鰓 噬
IBM code page 949 (prefixed with 0x9C)[12][22]
0 1 2 3 4 5 6 7 8 9 A B C D E F
婿 齟 射 單 尠 愃 洗 燹 霰 偰 契 挈 艘 霄 蟀
瑣 叟 宿 晬 溲 祟 雎 鶉 虱 啻 寺 緦 矧 瑟 萼 贋
鴈 戞 遏 嵒 諳 黯 鞅 欸 皚 礙 靉 阨 射 篛 籥 羘
敔 恚 射 羨 臙 蠕 讌 塩 饜 嬰 睨 翳 蕋 遨 媼 薀
鰮 蕘 舂 蛹 吁 熨 蜿 幃 衞 囿 帷 蕤 黝 鬻 檼 珢
齦 挹 栮 頣 仞 眥 粢 耔 觜 赭 柞 潜 蚕 嶂 瘴
IBM code page 949 (prefixed with 0x9D)[12][22]
0 1 2 3 4 5 6 7 8 9 A B C D E F
装 纔 柢 蛆 豬 糴 囀 巓 磚 翦 窃 椄 梃 晢 瑅
踶 吊 噪 皁 竈 笊 糶 絛 鯛 樅 蹤 蔟 肘 隼 則 証
痣 湌 慚 刱 悵 氅 簀 蜴 躑 濺 簷 蜻 砌 靆 峭 綃
鈔 鞘 數 躅 髑 怱 葱 摧 槌 甃 箒 鞦 麁 麤 杻 舳
冲 橇 贅 巵 徴 鵄 忱 拆 橐 駄 幀 蝙 庖 炮 舖 鉋
鞄 分 蓖 蹕 瘧 邯 鷳 炕 廨 慊 篋 陜 皞 醐 鶻

Lead bytes 0x9E–A0 (extended hanja and syllables)

According to the 1992 specification, this entire range is user-defined.[11] As implemented in the codec contributed to ICU by IBM, 0x9EA1 through 0x9EAC contain the remainder of the extended hanja. The rest of the range contains a few additional Hangul syllables which are not available in pre-composed form in pure EUC-KR. Unlike Unified Hangul Code, this is insufficient to support all non-partial Johab syllables absent in Wansung code.[12]

Significant amongst these are 뢔 (rwae, 0x9EFC), 쌰 (ssya, 0x9FE6), 쎼 (ssye, 0x9FED), 쓔 (ssyu, 0x9FF3) and 쬬 (jjyo, 0xA0C1), which correspond to the beginnings of the standard Wansung characters 뢨, 썅, 쏀, 쓩, and 쭁 respectively, when partly entered in an input method editor.

IBM code page 949 (prefixed with 0x9E)[12]
0 1 2 3 4 5 6 7 8 9 A B C D E F
鑊 圜 懽 鬟 媓 怳 囂 猴 篌 忻 迄 頡 갂 갋 걹
겇 겓 곩 곺 괙 괨 괫 궛 귕 귬 긂 긏 긑 긧 긼 깄
깉 깢 꺠 꼄 꼳 꽌 꽘 꽛 꽨 꾓 꾲 꾿 꿘 꿧 뀍 뀡
끠 낐 낻 냬 넏 넞 녇 녓 녙 녯 녺 놧 놰 눳 늧 닁
닑 닠 댱 댸 덨 덪 뎜 돓 됀 됏 됬 둗 둿 뒴 듁 듧
딮 딲 딷 딿 땨 떄 뗴 뚀 뚸 뜌 럐 렏 뢔 룜 뤗
IBM code page 949 (prefixed with 0x9F)[12]
0 1 2 3 4 5 6 7 8 9 A B C D E F
릐 맟 맻 먜 멫 멭 몀 몯 뫃 뫠 믁 믕 믜 믠 밎
밨 밷 뱜 뱨 벘 벜 벹 볌 볒 볓 볔 봣 붗 붴 븘 븡
븨 빋 뺜 뺴 뻭 뻰 뻴 뻿 뼤 뽜 뽸 뿀 뿕 뿝 뿨 쀄
쀠 쁙 쁴 삮 삷 삻 샃 샇 샏 섥 섿 셑 셗 솓 솻 슌
슳 싀 싦 쌂 쌋 쌧 쌰 썃 썌 썻 쎅 쎙 쎠 쎼 쏼 쐿
쑷 쒓 쓓 쓔 씼 씿 앏 앟 얐 얫 얶 엱 엳 옝 옫
IBM code page 949 (prefixed with 0xA0)[12]
0 1 2 3 4 5 6 7 8 9 A B C D E F
옺 욷 웟 윋 윶 읻 잧 잪 젇 젔 젛 젹 졋 좐 좜
좠 좬 좰 좸 죨 죰 죱 줫 쥭 즤 짔 쨰 쩗 쩰 쪗 쪠
쫒 쬬 쮀 쯥 쯰 찟 찦 찯 찿 챂 챱 챼 쳣 쳥 쵀 췃
츼 칻 캗 캩 컈 컽 켙 쾍 쾐 쾟 쾬 쾽 킈 턔 텠 텩
퉷 튓 틍 틧 팊 팦 퍙 퍠 펲 펵 폇 퐤 풰 퓩 픅 픐
픙 픠 픤 핟 핡 핬 핱 햬 헏 혬 횩 횸 훕 휌 흭

Lead bytes 0xA1–C8, 0xCA–FD (standard Wansung)

See also

Footnotes

  1. ↑ This is not included for IPA support. Rather, in Code page 933, SO 0x4160 is a not-equals sign displayed with a slash, while IBM-933 SO 0x418D is one displayed with a backslash (i.e. =⃥).[11] Although it is IBM-933 SO 0x4160 which is mapped to the usual not-equals GCGID SA540080 (fullwidth of SA540000), it is IBM-933 SO 0x418D which is mapped to EUC-KR and IBM-949 0xA1C1,[11] due to the reference glyph for the not-equals sign in KS C 5601-1987 also showing it with a backslash.[23] Hence, U+2260, which is mapped to EUC-KR and therefore IBM-949 0xA1C1, is mapped to IBM-933 SO 0x418D, leaving IBM-933 SO 0x4160 (and therefore IBM-949 0x9AA6) to be mapped to the visually similar character at U+01C2.[24]

References

  1. ↑ 1.0 1.1 Borgendale, Ken. "OS/2 Codepage and Keyboard Display Tools". http://www.borgendale.com/tools/tools.htm. 
  2. ↑ van Kesteren, Anne, "5. Indexes (§ index EUC-KR)", Encoding Standard (WHATWG), https://encoding.spec.whatwg.org/#index-euc-kr 
  3. ↑ van Kesteren, Anne. "4.2. Names and labels". Encoding Standard. WHATWG. https://encoding.spec.whatwg.org/#names-and-labels. 
  4. ↑ 4.0 4.1 4.2 4.3 4.4 "Converter Explorer: ibm-949_P110-1999 (alias x-IBM949)", International Components for Unicode (Unicode Consortium), http://icu4c-demos.unicode.org/icu-bin/convexp?conv=ibm-949_P110-1999&s=ALL 
  5. ↑ 5.0 5.1 "Converter Explorer: ibm-949_P11A-1999 (alias x-IBM949C)", International Components for Unicode (Unicode Consortium), http://icu4c-demos.unicode.org/icu-bin/convexp?conv=ibm-949_P11A-1999&s=ALL . This is the ASCII-based version of IBM-949.
  6. ↑ "windows-949-2000", Converter Explorer (International Components for Unicode), http://demo.icu-project.org/icu-bin/convexp?conv=windows-949-2000 
  7. ↑ "codecs — Codec registry and base classes § Standard Encodings". Python 3.7.2 documentation. Python Software Foundation. https://docs.python.org/3.7/library/codecs.html#standard-encodings. 
  8. ↑ 8.0 8.1 8.2 "Coded character set identifiers: CCSID 949". IBM Globalization. IBM. http://www-01.ibm.com/software/globalization/ccsid/ccsid949.html. 
  9. ↑ "CCSID 1088 information document". http://www-01.ibm.com/software/globalization/ccsid/ccsid1088.html. 
  10. ↑ "Code page 951 information document". https://www-01.ibm.com/software/globalization/cp/cp00951.html. 
  11. ↑ 11.0 11.1 11.2 11.3 11.4 11.5 11.6 11.7 11.8 11.9 "IBM Korean Graphic Character Set: DBCS-Host and DBCS-PC". 2001. https://public.dhe.ibm.com/as400/products/clientaccess/win32/files/globalization/Korean_base1992.pdf. 
  12. ↑ 12.00 12.01 12.02 12.03 12.04 12.05 12.06 12.07 12.08 12.09 12.10 12.11 12.12 12.13 12.14 International Components for Unicode (ICU), ibm-949_P110-1999.ucm, 2002-12-03, https://github.com/unicode-org/icu/blob/master/icu4c/source/data/mappings/ibm-949_P110-1999.ucm 
  13. ↑ "Coded character set identifiers: CCSID 934". IBM Globalization. IBM. http://www-01.ibm.com/software/globalization/ccsid/ccsid934.html. 
  14. ↑ 14.0 14.1 "Coded character set identifiers: CCSID 944". IBM Globalization. IBM. http://www-01.ibm.com/software/globalization/ccsid/ccsid944.html. 
  15. ↑ Viswanadha, Ram (2001-11-01). "ICU-1281 Remove unwanted ucmfiles". International Components for Unicode. https://github.com/unicode-org/icu/commit/4b5d175d834a24a0ec08fbbf1d2e20385ef78af1#diff-8403419f92b19da4ade420a7d6a94b603a7d0bd5f62d672eee888a62f50a2886. 
  16. ↑ Code Page CPGID 01088 (pdf), IBM, https://public.dhe.ibm.com/software/globalization/gcoc/attachments/CP01088.pdf 
  17. ↑ Code Page CPGID 01088 (txt), IBM, https://public.dhe.ibm.com/software/globalization/gcoc/attachments/CP01088.txt 
  18. ↑ The Unicode Standard, Version 1.1. Unicode Consortium. pp. 3–4. UTR #4. 
  19. ↑ 19.0 19.1 "CPGID 01449: IBM default PUA". IBM Globalization: Code page identifiers. IBM. http://www-01.ibm.com/software/globalization/cp/cp01449.html. 
  20. ↑ IBM (1997), unicode.nam: Allow the Unicode characters to be specified using either the IBM or PostScript like names.  (Included with Borgendale, Ken, OS/2 Codepage and Keyboard Display Tools, http://www.borgendale.com/tools/tools.htm )
  21. ↑ "ibm-933_P110-1995.ucm". International Components for Unicode. https://raw.githubusercontent.com/unicode-org/icu/main/icu4c/source/data/mappings/ibm-933_P110-1995.ucm. 
  22. ↑ 22.0 22.1 22.2 22.3 Private Use Area mapped hanja are identified from code charts. The IBM document C-H 3-3220-125 1992-09 gives code charts for the code pages used as the double-byte components for Code page 933 and an older version of Code page 949 without these extensions; however, the hanja in this section correspond to (and are in the same order as) the subset of table 7 for which a "PC Code" is not listed.[11] The Corporate Private Use Area mappings are also co-ordinated with other code pages,[19] including Code page 933,[21] which can be used to obtain the "Host Code" for a given Corporate Private Use Area mapping.
  23. ↑ Korea Bureau of Standards (1988-10-01), Korean Graphic Character Set for Information Interchange, ITSCJ/IPSJ, ISO-IR-149, https://www.itscj.ipsj.or.jp/iso-ir/149.pdf 
  24. ↑ "ibm-933_P110-1995 (lead bytes 0E41)". Converter Explorer. International Components for Unicode. https://icu4c-demos.unicode.org/icu-bin/convexp?conv=ibm-933_P110-1995&b=0E41&s=ALL#layout. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Code_page_949_(IBM)&oldid=3012009"