Natural Annotation Research in Large-Scale Corpora with a Focus on Chinese Word Segmentation
Endong Xun · Beijing Daxue Xuebao. Zirankexueban · 2013
The distribution and meaning of natural annotations on large datasets are discussed. The proposed research on word extraction shows the positive potential of both implicit and explicit natural annotation in word segmentation. Experiments on word extraction indicates that the implicit natural annotation derived from language laws and patterns are more powerful in splitting character strings in raw corpora.