Word Segmenter for Chinese Micro-blogging Text Segmentation – Report for CIPS-SIGHAN’2014 Bakeoff
Lu Xiang, Xiaoqing Li, Zhou Yu · 2014
This paper presents our system for the CIPS-SIGHAN-2014 bakeoff task of Chinese word segmentation.This system adopts a characterbased joint approach, which combines a character-based generative model and a character-based discriminative model.To further improve the performance in cross-domain, an external dictionary is employed.In addition, pre-processing and post-processing rules are utilized to further improve the performance.The final performance on the test corpus shows that our system achieves comparable results with other state-of-the-art systems.