Improved Chinese word segmentation method based on dictionary
Shou Zhao-yu · Jisuanji gongcheng yu sheji · 2013
In order to segment Chinese words quickly and accurately,a new word segmentation method is proposed based on the traditional word dictionary structure and the corresponding algorithms.Double hash structure and improved positive maximal matching algorithm are utilized in the proposed method.And hence,the method can improve the speed of segmentation and largely eliminates ambiguities caused by maximum matching method.Experiments show that the proposed method improves segmentation accuracy rate and largely shorten time for segmentation.