Identification of Abbreviated Word in Tibetan Word Segmentation
Cai Zhijie · Zhongwen xinxi xuebao · 2009
In Tibetan information processing,the word is to be treated as the fundamental unit for parsing,the sentence comprehension,the automatic abstract,the automatic classification,the machine translation and so on,Therefore,Tibetan word segmentation is essential for Tibetan information processing.Through the analysis of abbreviated word in Tibetan,,this article proposes a new method of restoration to identify the abbreviated word for Tibetan word segmentation.The basic idea of the restoration method is to re-establish the abbreviated Tibetan word to its original form by the reinstallation rules.The method has been applied in a research project of National Language Committee,with a testing result from a 850000 byte Tibetan corpus reaching the accuracy of 99.83%.