State of the art and difficulties in Chinese word segmentation technology
Yanji Liu · Information technology newsletter · 2009
Chinese word segmentation is a basic research issue on Chinese information processing tasks.And Chinese word segmentation is a very important component in many field of Chinese information process.The paper proposes an unsupervised training method for acquiring probability models that accurately segment Chinese character sequences into words.Then it presents a detailed analysis of the two great dificulties in word segmentation.And finally,it points out the research problems to be resolved on Chinese word segmentation.