Which Is Essential for Chinese Word Segmentation: Character versus Word
Changning Huang, Hai Yan Zhao · Institutional Repositories DataBase (IRDB) · 2006
Abstract. This paper proposes an empirical comparison between word-based method and character-based method for Chinese word segmentation. In three Chinese word segmentation Bakeoffs, character-based method quickly rose as a mainstream technique in this field. We disclose the linguistic background and sta-tistical feature behind this observation. Also, an empirical study between word-based method and character-based method are performed. Our results show that character-based method alone can work well for Chinese word segmentation without additional explicit word information from training corpus. 1