High OOV-Recall Chinese Word Segmenter.

XU Xiao-ming, Muhua Zhu, Xiaoxu Fei, Jingbo Zhu · 2010

For the competition of Chinese word segmentation held in the first CIPS-SIGHNA joint conference. We applied a subwordbased word segmenter using CRFs and extended the segmenter with OOV words recognized by Accessor Variety. Moreover, we proposed several post-processing rules to improve the performance. Our system achieved promising OOV recall among all the participants. 1

Read the paper · More papers on PaperTik