Analysis and application of Chinese word segmentation model which consist of dictionary and statistics method
Mei Luo · Jisuanji gongcheng yu sheji · 2012
To solve the problem that there is a lack of efficiency and recognition ability in the dictionary-based word segmentation method and in the statistical-based word segmentation method,the specific areas of product name text data in E-commerce is analyzed,and the mmseg word segmentation method and mutual information processing method are researched.A rapid and highly accurate word segmentation model is designed and proposed,two types of word segmentation method are untilled,and mmseg segmentation algorithm and mutual information segmentation algorithm are applied in word segment processing.The test proves that this model can provide a better solution for segmentation speed and efficiency.