Universal Text Preprocessing and Postprocessing for PPM Using Alphabet Adjustment
Khaled M. Alhawiti, William J. Teahan · 2014
In this paper, we introduce several new universal pre-processing techniques to improve Prediction by Partial Matching (PPM) compression of UTF-8 encoded natural language text. These methods essentially 'adjust' the alphabet in some manner (for example, by expanding or reducing it) prior to the compression algorithm then being applied to the amended text.