Software:MeCab

From HandWiki
Short description: Open-source text segmentation library
MeCab
Developer(s)Taku Kudou, Google Japanese Input project
Stable release
0.996 / 18 February 2013; 11 years ago (2013-02-18)
Written inC++, has modules for C, C#, Java, Perl, Python, and Ruby
PlatformCross-platform
LicenseTri-licensed under GPL, LGPL and BSD licenses
Websitehttps://taku910.github.io/mecab

MeCab is an open-source text segmentation library for use with text written in the Japanese language originally developed by the Nara Institute of Science and Technology and currently maintained by Taku Kudou (工藤拓) as part of his work on the Google Japanese Input project.[1][2] The name derives from the developer's favorite food, mekabu [ja] (和布蕪), a Japanese dish made from wakame leaves.

The software was originally based on ChaSen and was developed under the name ChaSenTNG, but now it is developed independently from ChaSen and was rewritten from scratch. MeCab's analysis accuracy is comparable to ChaSen, and its analysis speed is 3–4 times faster on average.

MeCab can analyze and segment a sentence into its parts of speech. There are several dictionaries available for MeCab, but IPADIC is the most commonly used one as with ChaSen.

In 2007, Google used MeCab to generate n-gram data for a large corpus of Japanese text, which it published on its Google Japan blog.[3]

MeCab is also used for Japanese input on Mac OS X 10.5 and 10.6, and in iOS since version 2.1.[4][5]

Example

Input:

ウィキペディア(Wikipedia)は誰でも編集できるフリー百科事典です

Results in:

ウィキペディア	名詞,一般,*,*,*,*,*
(	記号,括弧開,*,*,*,*,(,(,(
Wikipedia	名詞,固有名詞,組織,*,*,*,*
)	記号,括弧閉,*,*,*,*,),),)
は	助詞,係助詞,*,*,*,*,は,ハ,ワ
誰	名詞,代名詞,一般,*,*,*,誰,ダレ,ダレ
でも	助詞,副助詞,*,*,*,*,でも,デモ,デモ
編集	名詞,サ変接続,*,*,*,*,編集,ヘンシュウ,ヘンシュー
できる	動詞,自立,*,*,一段,基本形,できる,デキル,デキル
フリー	名詞,一般,*,*,*,*,フリー,フリー,フリー
百科	名詞,一般,*,*,*,*,百科,ヒャッカ,ヒャッカ
事典	名詞,一般,*,*,*,*,事典,ジテン,ジテン
です	助動詞,*,*,*,特殊・デス,基本形,です,デス,デス
EOS

Besides segmenting the text, MeCab also lists the part of speech of the word, and, if applicable and in the dictionary, its pronunciation. In the above example, the verb できる (dekiru, "to be able to") is classified as an ichidan (一段) verb (動詞) in the infinitive tense (基本形). The word でも (demo) is identified as an adverbial particle (副助詞). As not all columns apply to all words, when a column does not apply to a word, an asterisk is used; this makes it possible to format the information after the word and the tab character as the comma-separated values.

MeCab also supports several output formats; one of which, chasen, outputs tab-separated values in a format that programs written for ChaSen can use. Another format, yomi (from 読む yomu, to read), outputs the pronunciation of the input text as katakana,[6] as shown below.

ウィキペディア(Wikipedia)ハダレデモヘンシュウデキルフリーヒャッカジテンデス

References

External links