New techniques for context modeling
Eric Sven Ristad, Robert G. Thomas · 1995
We introduce three new techniques for statistical language models: extension modeling, nonmonotonic contexts, and the divergence heuristic. Together these techniques result in language models that have few states, even fewer parameters, and low message entropies.