A Hierarchical Word Sequence Language Model
Xiaoyi Wu, Yūji Matsumoto · Waseda University Repository (Waseda University) · 2014
Most language models used for natural language processing are continuous.However, the assumption of such kind of models is too simple to cope with data sparsity problem.Although many useful smoothing techniques are developed to estimate these unseen sequences, it is still important to make full use of contextual information in training data.In this paper, we propose a hierarchical word sequence language model to relieve the data sparsity problem.Experiments verified the effectiveness of our model.