An Improved Mechanism on the Chinese Word Segmentation
Yi Guo · Computer Knowledge and Technology · 2008
This paper studied the Technology of Chinese word segmentation,improved the traditional whole Chinese word binary seg-mentation mechanism,provided a new dictionary mechanism: organized according to the number of the word count of the Chinese words.The dictionary is very easy to update and append new words.And it put forward a new fast algorithm of Chinese word segmentation based the new dictionary mechanism.Through contrastive experiments it proves that the new algorithm having faster Chinese word segmenting speed than whole Chinese word binary segmentation,one by one word Chinese word binary segmentation and the TRIE tree Chinese word segmentation.