A CRF Sequence Labeling Approach to Chinese Punctuation Prediction
Yanqing Zhao, Chaoyue Wang, Guohong Fu · Institutional Repositories DataBase (IRDB) · 2012
This paper presents a conditional random fields based labeling approach to Chinese punctuation prediction.To this end, we first reformulate Chinese punctuation prediction as a multiple-pass labeling task on a sequence of words, and then explore various features from three linguistic levels, namely words, phrase and functional chunks for punctuation prediction under the framework of conditional random fields.Our experimental results on the Tsinghua Chinese Treebank show that using multiple deeper linguistic features and multiple-pass labeling consistently improves performance.