Chinese character description languages
The Chinese character description languages are several proposed languages to most accurately and completely describe Chinese (or CJK) characters and information such as their list of components, list of strokes (basic and complex), their order, and the location of each of them on a background empty square. They are designed to overcome the inherent lack of information within a bitmap description. This enriched information can be used to identify variants of characters that are unified into one code point by Unicode and ISO/IEC 10646, as well as to provide an alternative form of representation for rare characters that do not yet have a standardized encoding in Unicode or ISO/IEC 10646. Many aim to work for Kaishu style and Song style, as well as to provide the character's internal structure which can be used for easier look-up of a character by indexing the character's internal make-up and cross-referencing among similar characters.
CDL
Character Description Language is a font technology, based on XML, co-created by Tom Bishop and Richard Cook for Wenlin Institute, Inc, designed for describing any CJK character, but suitable for describing any glyph.
This XML-based declarative language defines the stroke order of each component (a subunit of the glyph similar to a radical, but not necessarily bearing the semantic significance of a true radical), as well as assembly of previously defined components to build up ever more complex characters. Many of these components are characters in their own right, in addition to serving as building-block components.
The background looks like a square of 128 pixels on each side. In this background:
- Each of about 50 strokes can be drawn in SVG.
- A basic component is composed by calling several strokes. In this component, each stroke is described by its bottom-left and top-right corner. Transformations are possible (reduction, enlargement, etc.). There are more than 1,000 basic components.
- A character is composed by calling several components. In this character, each component is described by its bottom-left and top-right corner. In order for a component to fit into its proper portion of the Chinese character's rectangular block, a component may be transformed (e.g., horizontal or vertical reduction or enlargement) upon its use as a building-block embedded within a containing more-complex character.
Accordingly, a set of less than 50 strokes[1] allow one to construct a set of about 1,000 components[2] which may in turn be embedded within tens of thousands of characters' descriptions.[2] A change in the shape of one of the 50 basic strokes is implicitly applied within each character that embeds that stroke. Likewise, a change to a component is implicitly applied within each and all characters whose assemblage uses that component.[2]
T. Bishop and R. Cook explain this as follows:
The stroke count of one character is generally related to the stroke counts of other characters. Most characters are built from components, and as long as the stroke counts of those components are defined, there is rarely any difficulty in adding them together to obtain the combined stroke count. Therefore, if a standard defines the strokes of a few thousand characters, it implicitly defines the strokes of many thousands of additional characters.[3]
(As of 2020) nearly 100,000 Chinese characters have been described via CDL.[4]
HanGlyph
A character description language intended for supplying missing rare characters in documents (addressing the Chinese equivalent of the gaiji problem).[5] Documents can contain markup for missing characters, which will automatically trigger the generation of small fonts to provide the characters. The language itself is a simple postfix notation describing strokes and ways to combine them. The prototype software uses Metapost to render the characters and embed them in LaTeX documents. The language was presented by Wai Wong in 1997,[6] and papers about its implementation in Metapost and LaTeX appeared at TeX user group conferences in 2003.[7][8]
Ideographic Description Sequences
Chapter 12 of the Unicode specification[9] defines a syntax for "Ideographic Description Sequences" (IDSs) intended for use in describing characters not included in the standard in terms of combinations of components that do have code points. Sixteen special characters in the range U+2FF0 to U+2FFF act as prefix operators to combine other characters or sequences to form larger characters.
| Character | Unicode Character Number | Full Unicode Name |
|---|---|---|
| ⿰ | U+2FF0 | Ideographic description character left to right |
| ⿱ | U+2FF1 | Ideographic description character above to below |
| ⿲ | U+2FF2 | Ideographic description character left to middle and right |
| ⿳ | U+2FF3 | Ideographic description character above to middle and below |
| ⿴ | U+2FF4 | Ideographic description character full surround |
| ⿵ | U+2FF5 | Ideographic description character surround from above |
| ⿶ | U+2FF6 | Ideographic description character surround from below |
| ⿷ | U+2FF7 | Ideographic description character surround from left |
| ⿼ | U+2FFC | Ideographic description character surround from right |
| ⿸ | U+2FF8 | Ideographic description character surround from upper left |
| ⿹ | U+2FF9 | Ideographic description character surround from upper right |
| ⿺ | U+2FFA | Ideographic description character surround from lower left |
| ⿽ | U+2FFD | Ideographic description character surround from lower right |
| ⿻ | U+2FFB | Ideographic description character overlaid |
| ⿾ | U+2FFE | Ideographic description character horizontal reflection |
| ⿿ | U+2FFF | Ideographic description character rotation |
Two additional ideographic description characters are scattered in other Unicode blocks. Note that U+303E 〾 IDEOGRAPHIC VARIATION INDICATOR is not officially an ideographic description character, but is sometimes used in ideographic description sequences.
| Character | Unicode Character Number | Block | Full Unicode Name |
|---|---|---|---|
| 〾 | U+303E | CJK Symbols and Punctuation | Ideographic variation indicator |
| ㇯ | U+31EF | CJK Strokes | Ideographic description character subtraction |
These sequences are useful in describing to the reader a character that is not directly printable, either because it is absent in a given font, or is absent from the Unicode standard altogether. For example, the Sawndip character "
" (encoded in CJK Unified Ideographs Extension F as U+2DA21 𭨡) can be described as "⿰書史". Another use is for dictionary lookup purposes, as a sort of rough input method for queries.
These sequences can be rendered either by keeping the individual characters separately or by parsing the Ideographic Description Sequence and drawing the ideograph so described.[10] They do not, by themselves, provide unambiguous rendering for all characters. For instance, the sequence ⿱十一 represents both 土 ("soil", the middle bar being narrower) and 士 ("bachelor", the middle bar being wider).
Unicode's specification for these sequences is based on the characters and syntax of the earlier GBK standard. Additional symbols are later encoded to fill in the missing combinations.
The IDSgrep free software package by Matthew Skala[11][12] extends Unicode's IDS syntax to include additional features for dictionary lookup; it is capable of converting KanjiVG's database to its own extended IDS format, or of searching EIDS files generated by the related Tsukurimashou font family.
KanjiVG
KanjiVG (Kanji Vector Graphics) is a free, Creative Commons-licensed Japanese character description language (intended to eventually expand to Chinese as well) based on the SVG vector graphics format.
SCML
In 2007, Structural Character Modeling Language was proposed as a different kind of XML-based Chinese-character description language whose positioning is not based on a numerical grid, as CDL and HanGlyph are. The known database of characters whose strokes and components are encoded in SCML is for demonstration-of-principle only; no known effort exists to attempt to encode, say, all of Unicode's CJK characters in SCML.
See also
- Unicode
- List of Shuowen Jiezi radicals, a system of 540 components used by Xu Shen (d. ≈147 AD) in his Shuowen Jiezi
- List of Kangxi radicals, a system of 214 components used by the Kangxi dictionary (1716), made under the leadership of the Kangxi Emperor
- List of Unicode radicals, a modern and computer-based ongoing attempt to create a complete and accurate set of CJK component list, led by Unicode.
- Cangjie input method
- Radical
- Stroke
- Stroke order
Notes
- ↑ Bishop & Cook 2013-12-31:p2
- ↑ 2.0 2.1 2.2 Bishop & Cook 2013-12-31:p9
- ↑ Bishop & Cook 2003b, pp. 8–9, point n⁰12
- ↑ Wenlin Institute webpage for CDL
- ↑ "HanGlyph". http://www.hanglyph.com/en/index.shtml.
- ↑ Wong, Wai (April 1997). "HanGlyph – a Chinese Character Description Language". Proceedings of the Seventeenth International Conference on Computer Processing of Oriental Languages, Hong Kong. Archived from the original on 2021-08-23. https://web.archive.org/web/20210823235130/http://docplayer.net/storage/49/25020270/1629766256/q7eApDa_AmX_QEpp_SEHgQ/25020270.pdf.
- ↑ Yiu, Candy L. K.; Wai Wong (July 2003). "Chinese Character Synthesis using METAPOST". Proceedings of the 24th Annual Meeting and Conference of the TeX User Group, Hawaii, U.S.A.. Archived from the original on 2011-07-26. https://web.archive.org/web/20110726055709/https://tug.org/TUGboat/tb24-1/yiu.pdf.
- ↑ Wong, Wai; Candy L. K. Yiu; Kelvin, C. F. Ng (June 2003). "Typesetting Rare Chinese Characters in LaTeX". Proceedings of the 14th European TeX Conference, Brest, France. Archived from the original on 2011-11-06. https://web.archive.org/web/20111106155533/https://tug.org/TUGboat/tb24-3/wong.pdf.
- ↑ https://www.unicode.org/versions/Unicode6.0.0/ch12.pdf[bare URL PDF]
- ↑ "The Unicode® Standard – Version 12.0 – Core Specification". Unicode Consortium. March 2019. p. 26. https://www.unicode.org/versions/Unicode12.0.0/ch18.pdf#page=24.
- ↑ "Tsukurimashou Font Family and IDSgrep Project Top Page - OSDN". http://en.sourceforge.jp/projects/tsukurimashou/.
- ↑ Skala, Matthew (2015). "A Structural Query System for Han Characters". International Journal of Asian Language Processing 23 (2): 127–159. http://colips.org/journals/volume23/23.2.4_idsgrep-article-final.pdf. Retrieved 2016-01-13.
External links
- CDL language from Wenlin Institute
- Wenlin Institute (2015), Wenlin User's Guide : Character Description Language, http://guide.wenlininstitute.org/wenlin4.3/Character_Description_Language
- Bishop, Tom; Cook, Richard, CDL specification, http://www.wenlin.com/cdl/
- Bishop, Tom; Cook, Richard (2003a), Character Description Language (CDL): The Set of Basic CJK Unified Stroke Types, https://www.unicode.org/L2/L2003/03420-cdl-strokes.pdf
- Bishop, Tom; Cook, Richard (2003b), A Specification for CDL Character Description Language, https://www.unicode.org/L2/L2003/03404-cdl-spec.pdf
- 2003/12/31 correction: Bishop, Tom; Cook, Richard (2003c), Specification for CDL, http://www.wenlininstitute.org/cdl/cdl_spec_2003_10_31.pdf, retrieved 2018-01-17
- Cook, Richard (2003), Chinese Character Description Languages, https://www.unicode.org/L2/L2003/03387-cook-cdl.pdf
- Bishop, Tom (2007), A character description language for CJK, Multilingual, #91, Volume 18 Issue 7, pp. 62–8, http://linguistics.berkeley.edu/~rscook/bishop/MLC-CDL.pdf
- Digital Humanities Start-up Grant from the U.S. National Endowment for the Humanities
- SCML
- Peebles, Daniel G. (May 29, 2007), SCML: A Structural Representation for Chinese Characters, Technical Report TR2007-592, Devin, Balkcom (advisor), Dartmouth College, pp. 30, http://www.cs.dartmouth.edu/reports/TR2007-592.pdf, retrieved August 30, 2009
- HanGlyph
- HanGlyph – a Chinese Character Description Language - Presentation, http://www.hanglyph.com/en/hanglyph-index.shtml, retrieved 2007-12-11
- HanGlyph – a Chinese Character Description Language - Reference Manual, 13 September 2003, pp. 31, http://www.hanglyph.com/en/hanglyph/reference.pdf, retrieved 11 December 2007
 |  |
