Method of Chinese word rough segmentation by maximum match and ambiguity detection algorithms
Hongqi Li · Computer Engineering and Applications Journal · 2012
Segmentation of words in Chinese text is very important preprocessing in Chinese information processing.In present,for some demerits such as low accuracy of Chinese word segmentation and big set of Chinese word rough segmentation,a method,CWRS,based on maximal match algorithm is proposed along with omni-segmentation algorithm.It greatly improves the accuracy and reduces the set of rough segmentation according to combination of ambiguity detection and cross ambiguity detection,which lays the foundation for precise segmentation of words in Chinese text.All the experiments are good effects by comparison of CWRS with other algorithms on the same data set of common Chinese texts.